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(57) Abstract 

A method and apparatus for organizing information in a computer filing system. The method and apparatus include the 
creation of a pile (23) comprising a ooUection of documents and displaying a graphical representation of the collection of docu- 
ments. The method and apparatus further include browsing the collection of documents (53) by pointing a cursor (21) at a parti- 
cular item in the collection of documents (53) to reveal an indicia (50) for the particular item in the collection of documents. The 
filing systan can automatically devide a pile (23) (e.g. a collection of documents from an electronic mail network) into subpiles 
on the basis of the conterit of each document in the pile, and the filing system, at the user's request can automatically file away 
documents into existing piles in the computer system on the basts of a similarity match between the content (or other internal re- 
presentation) of the document and the content (or other internal representation) of existing piles in the computer system. The fil- 
ing system can also create a pile (23) from a sample document by using the internal representation of the document as the internal 
representation of the new pile. The computer filing system provides various interfaces in connection witii piles to the user of the 
system to provide feedback and other information to the user, including information concerning the documents and piles in the 
computer's filling system. 



wo 93/22738 PCT/US93/02878 

METHOD AND APPARATUS FOR ORGANIZIHG INFORMATION 
IN A COMPUTER SYSTEM 
BACKGROUND OF THE INVFNTinN 

Field of the Invention 



5 The present invention relates to the field of computer systems and more 

patticulariy to user interfaces for computer systems and to methods and 
apparatuses for implementing user interfaces for organizing information in a 



computer system. 




10 Prior Art 



Prior art computer systems for organizing information typically fall Into 
two types of filing systems. These filing systems are often implemented as part 
of the operating system of the computer system and are therefore prodded as a 
1 5 basic utility to the user of the system to allow the user to organize information in 
a manner desired by the user. The two types of systems referred to above are 
the flat file system and the hierarchical file system. 

In the flat file system, the computer stores all files (e.g. documents) at one 
2 0 level of hierarchy such that the user when examining these files sees ail files at 
this level. In other words, the ^stem does not disc^minate between files wMch 
the user may have put in a folder or a subdrectory and files which are not in 
folders or subdirectories. This type of flat filing system is similar to a desk where 
all documents on the desic are spread out with none in any folders or other 
2 S containers. Clearly, such a filing system becomes cumbersome when the 
number of documents becomes large. For example, if the user is searching for 
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a partrcular document on the system, the user may have to search through a 
brig list of documents in order to find the desired document. 



5 systems by providing a hierarchy of folders or subdirectories into which the user 
may store information, such as text documents. Examples of hierarchical fiGng 
systems are well known in the prior art, including a hierarchical filing system 
disclosed in U.S. Patent No. 4.945,475. In these hierarchical filing systems, the 
user will fife a document into a folder which may itself be within another folder. 
1 0 Looking for any documents within a first folder will require opening the first 
folder after opening the second foWer which contains the first folder. In this 
manner, the user is not presented with a bevwldenng number of documents as 
In the flal filing system and the user's files are maintained In an orderly and 
systematic way within the hieiarctv speafied by the user. An example of this 
1 5 hierarchical fiOng is shown in Rgure 2 of the U.S. Patent 4,945,475 wherein 
documents 21 and 22 are within foWer 20 which itself Is within fokJer 18 which 
is also stored in another folder, folder 17. Thus. ln order to view documents 21 
and 22 the user must direct the computer system to examine the contents of the 



s ubdirectory represented by foMer 2 0 by specifying the full address of folder 20 
2 0 (in the case of a non-graphical user interface) or by opening the series of 
folders necessary to obtain a wew of the folder containing the dea'red 
documents Qn the case of a graphical user interface). Current versions of the 



of hierarchical filing systems with graphical user interfaces, and other such filing 
25 systems with graphfcal user interfaces are well known. 




Hierarchical filing systems on computers attempt to Improve filing 




Rnder on the Macintosh computer systems from Apple Computer are examples 
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While these hierarchical filing systems allow the user to specify a 
structure within which to file (and hence store) Information in order to avoid the 
clutter of a flat filing system, the hierarchical structure forces the csomputer user 
to be as organized as possible In filing Information. If the user, as is often the 
5 case, has difficulty In filing documents because of the difficulty' In deciding the. 
proper categories of the document (e.g. the document does not clearly apply to 
any current category of filing where the category Is implemented by having a 
folder or subdirectory for the category) then the user is typically most 
comfortable allowing the document to appear in the upper most directory of the 
1 0 hierarchy. As more and more documents which are stored in the computer 
system memory are left in the highest directory due to the difficulty in fifing those 
documents, the user begins to have a bewildering clutter of documents in that 
highest directory, which then makes the system act as if it were a flat filing 
system (at least to the extent of the highest directory or to some other 

1 5 directory/subdirectory where the user is placing documents which are difficult to 

file away). It should be also noted that the difficulty in filing documents in a 
computer system also affects the way the user interacts with the computer In thai 
the user attempts to avoid the difficult work involved In filing a document which 
Is hard to categorize. This leads to procrastination or avoidance of the task. 

2 0 This tends to result In the computer becoming cluttered with documents which 

are hard to categorize or otherwise file or the user does not attempt to place the 
documents on the computer system at all because of the reafization that they 
will be difficult to organize. This effect tends to negate the advantages of a filing 
system having a graphical user interface, and particuarly a hierarchical filing 
2 5 system with a graphical user interface. 
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The problems discussed above are particularly troublesome in the case 
of mall documents (e.g. electronic mail documents) which have not been read 
by the user or have only been gfanced at. By their nature, these documents are 
most difficult to categorize and file away because the user is not fully familiar 
5 with these documents. It will be appredated that the computer user is 

responsible for appropnately filing alt items; the system offers little assistance in 
this often tedious task. 

The prior art has not prpwded solutions to deal with these problems. For 
1 0 example, Mafone has studied the way people work In their physical offices and 
has noted the significance of piles of documents in these physical offices, and 
has discussed the implicatiorts for the design of electronic office information 
systems which might use conventional office management tools, such as piles, 
in a computer based information system. See, Malone, T.W.. How do people 
1 5 organize their desks? Implications for the design of office information systems. 
ACM Transactions on Office Information Systems, Volume 1 , Number 1 , 
January 1983^ Pages 99-112. Malone however does not describe how such a 
computer system would be implemented nor the graphicai user interface 
involved in dealing with such piles or browsing such plies and other acli^^ies 
20 relating to these piles. 



j The present invention proA^des an improved filing system with a 

graphical user interface which allows users to organize information into piles or 



collections of documents and assists the user in organizing these collections of 
25 documents. 



SUMMARY QF THE INVENTiQN 
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5 



The Invention provides a method and apparatus for organizing 
information in a computer system, particularly one having a graphical user 
<^ interface which Includes graphical representations of documents. The 

5 apparatus of the Invention displays graphical representations of a plurality of 
documents each of which may be manipulated by the user by positioning a 
system cursor over one of the graphical representations (e.g. Icon) and 
signalling to the computer to select the document for some operation specified 
^f'e user. In the method of the Invention, the user creates a pile (or collection 
. , V * ® °^ by positioning the cursor (for example, a pointer) over one 

j; T^c 1 graphic al representation of a document and then selecting that document and 

j moving the graphical representation of the document (by moving the cursor) 
I over to another graphical representation of another document and then 
^ depositing the first document on top of the second document In order to create a 

1 5 pile. The system will typically display a graphical representation of the pile 

which is different than the graphical representation of each document 
separately and after a pile is created, the original graphical representation of 
each document in the collection will typically no longer be displayed. A side- 
ways view of the graphical representation of the document replaces the original 

2 0 graphical representation of the document, and the side-ways view of the 

graphical representation is located in the graphical representation of the 
collection. The user may then browse through the pile by positioning the cursor 
at an item in the pile for a predetermined period of time to reveal a proxy within 
a viewing cone for the item positioned under the cursor. After the user creates a 
^ * 25 pile, the system may display a base (or plinth) under the pile to further indicate 

to the user that the collection of documents is a pile and to allow the user to 
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select the pile as a group. The user may theri select the pile for further action by 
pointing the cursor to the base of the pile. 

The apparatus of the invention includes a processing means, such a 
5 microprocessor which Is coupled to a cursor controlling device, sUch as a 
mouse and is coupled to a display means such as a video display screen and Is 
also coupled to memory (e.g. RAM or a hard disk) for storing documents 
maintained In the filing system of the computer. The cursor control device, such 
as a mouse, typically includes a means for controlling the position of the cursor 
1 0 on the display screen and also includes a signal generation means, such as a 
switch which is mechanically coupled to a button which is depressed by the 
user to signal to the computer to make a selecUon of an item which is positioned 
under the cursor. 

1 5 The system and method of the Invention provide the user with various 

ways to organize piles and to manipulate piles stored in the filing system of the 
computer. For example, the filing system may be used to automatically file new 
documents into the appropriate pile according to criteria specified by the user or 
accordihg to the internal contents of the document relative to the contents of a 

2 0 particular pile. The invention also provides a way for the user to visualize the 
contents of a pile according to various criteria (e.g. date), such as using visual 
cues iBuch as color. The appearance of the graphical representation of the pile 
(e.g. dynamic or static icon of the pile) provides further information to the user, 
including the texture, thickness, and color of the various documents within the 
25 pile. IWoreover, the user may specify to the system that it is the user's 

preference to have system created piles look neat and user created piles look 
disheveled. The system may also, at the user's request, create subpiles from an 



"^^^^^^ PCr/US93/«2878 



Original pile (or any set of selected documents such as documents within a 
folder) according to criteria specified by the user or determined or suggested by 
the system. 

5 Another aspect of the present invention is an apparatus and method for 

providing an internal representation of the contents of a pile, which 
representation Is used as a criteria for organizing d ocuments and folders within 
the pile. This Internal representation is also used when the system 
automatically files documents at the user's request or automatically when a new 

1 0 or modified document appears In the filing system of the computer. The internal 
representation may also be used when the system creates subpiles from an 
original pile or when searching for documents in the filing system and for other 
operations relating to the present invention. In the preferred embodiment of the 
present invention, each document is provided with a vector which is 

1 5^ representative of the words contained in the document and each pile includes a 
representation, such as a vector, which embodies the collective contents of the 
pile. The vector between a document and a pile may be compared for the 
purpose of determining the relatedness/ similarity of the document t o the pile for 
purposes of filing or other operations described as part of this Invention. 



20 



25 



BRIEF DESORIPTiON nPTHF DRAWINR.q 

Figure 1 shows an embodiment of a computer system of the present 
invention. 

Figures 2a. 2b. 2c. 2d. 2e. 2f. 2g. 2h. 2i. 2j. 2k and 21 show various 
embodiments and representations of piles according the present Invention. 
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Figure 3 shows, in temporal fashion, an embodiment of the operation of 
creating a new pile. 

5 Figures 4a, 4b, 4c, 4d, 4e and 4f show various embodiments of the 

operation of browsing a pile. 

Figures 4g, 4h, 4i. 4j, 4k, 41 and 4m show stages over time of an 
embodiment of browsing a pile. 

10 

Figures 5a and 5b show two embodiments relating to moving a pile as a 

unit. 

Figure 6 shows. In temporat fashion, the operation of adding an item to 
15 the top of a pile. 

Rgure 7 shows. In temporal fashion, the operation of adding an item to 
the middle of a pile. 

2 0 Figures 8a and 8b show, in temporal fashion, the operation of obtaining 

an alternate view for two different embodiments of the invention. 

Rgures 8c and 8d show another embodiment for obtaining an alternate 
view of a pile according to the present Invention. 

25 

Figures 9a and 9b show. In temporal fashion, the operation of remo>rfng 
one item from a pile; two embodiments are shown. 
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Figures 10a and 10b show, in temporal fashion, two embodiments of the 
operation of removing multiple Items from a pile. 

5 Figure 1 1 a shows, in temporal fashion, a particular embodiment for 

creating a pile with the use of an outer zone. 

Figure lib shows, In temporal fashion, an embodiment for creating a pile 
with the use of an inner zone to allow fine positioning of the pile's appearance. 

10 

Rgure 12a shows an embodiment for adding to a pile using an outer 

zone. 

Figure 12b shows a method for adding to a pile using an Inner zone to 
1 S allow fine positioning. 

Figure 13a shows a visualization window containing a user pile. 

Figure 13b shows another visualization window containing four plies. 
2 0 Figure 14 shows a script/criteria control window according to the present 

invention. 

Figure 15 shows a flowchart for Indexing documents according to the 
method and apparatus of the present invention. 

25 

Figure 16 shows a method for browsing a pile and displaying proxies of 
documents within the pile. 
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Figure t7 shows a method for allowing the system to control the filing of 
items within piles. 

5 Figure 1 8a shows a flowchart for the creation of subplles by the computer 

system of the present invention, and Rgure ISb shows a flowchart forthe 
creation of subpiles where the number of subpiles has been restricted by said 
user. 



10 



Figure 19 shows a flowchart for searching of documents in the file system 
of the present invention. 



Figure 20 is a flowchart showing a method for visualizing a pile by color. 

15 Rgure 21, in flowchart form, shows a typical example of a user 

performing operations on or with piles, 

Figure 22a. 22b. 22c 22d. and 22e show other examples of a user 
performing operations with piles; various screens of a computer system 
20 operating according to the invention are shown. 

DETAILED DFSCRiPTinM npj ^E iNVFMTinM 

A portion of the disclosure of this patent document contains material 
2 5 which is subject to copyright protection and to which a claim of copyright 
protection is made. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent disclosure, as It appears In the Patent and 
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Trademark Office patent files or records, but otherwise reserves all copyrights 
and similar rights whatsoever. © Copyright Apple Computer. Inc. 



A system and method for organizing information stored in a file system of 
5 a computer system will now be described in detail. The following description, 
specific steps, procedures, commands, and other specifics are set forth in order 
to provide a thorough understanding of the present invention. However, it will 
be apparent to one skilled in the art that the present invention may be practiced 
without the specific details, in other instances, well linown systems and 
1 0 methods are shown in diagrammatic form or not shown at all in order to not 
obscure in unnecessary detail the present Invention. 



The computer filing system of the present Invention is part of the 
computer system shown in Figure 1. The computer system includes a 
1 5 processing means 10. such as a microprocessor, a memory means 11, such ai 
system RAM, and a mass storage means 1 2. such as a hard disk or other 
storage means having a high capacity for storing documents and other 
information maintained by the filing system. The processing means 10. the 
memory means 11. and the storage means 12 (which its own VO controller) are 
2 0 interconnected by a system bus 15 which includes control signals as well as 
address fines and data lines for sharing information, including data and 
instructions, between the components of the computer system. Also connected 
to the system bus 15 is the I/O controller 1 7 which controls the signals received 
from the keyboard 14 and the mouse 16 and provides those signals, which 
2 5 indicate instmctions from the user, to the computer system. The display 

controller 18 Is coupled to the system bus 15 and receives commands and data 
from the processing means 10 and from the memory means 1 1 via the system 



12 

bus 15. The display controller 18 controls the display devioe 19 in order to 
provide Images on a display screen 22. It will be appreciated that the typical 
computer system Includes a bit mapped screen stored in memory, which may 
be a dedicated frame buffer memory or the system memoiy. As shown in Figure 
5 1. the display means 19 displays on Its display screen 22 a cursbr2l which is 
controlled by the cursor control device shown In Figure 1 as a mouse 16. The 
display means 19 may be any one of a variety of Icnown display systems, such 
as a video (CRT) display monitor or a b'quid crystal display. 

1 0 The cursor control device of the present invention may be substantially 

Identical to the cursor control means shown In U.S. Patent No. Reissue 32.632. 
However, it will be understood by those in the art that many other types of cursor 
control means may be utilized, such as graphic tablets, touch tablets, trackballs, 
pen input mechanisms, touch screens, etc. Indeed, any device capable of 

1 5 indicating x-y locations and capable of controlling a cursor on a display means 
of the computer system may be utilized In the present invention as the cursor 
control device. The cursor control device, such as a mouse will often include a 
signal generation means which typically Includes a switch connected to a 
button. A userpressesthe button to send one signal to the computer and 
2 0 releases the button to send another signal to the computer. Other signal 
generation means, as is well known in the art, may be used such as using 
certain keys on a keyboard or lising a pen Input device which both positions a 
cursor and, by pressing the pen's tip against the display screen, selects the Itsm 
pointed to/pressed at on the display screen. 



25 



The display means 19 of Figure 1 is shown displaying a pile 23 to the left 
of the cursor 21. A menu bar 20 (described in U.S. Patent No. 4.931,783) is 
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also displayed at the top of the display screen 22. In the preferred embodiment 
of the present Invention, the file system operates on a Macintosh computer of 
Apple Computer. Inc. of Cupertino. California. In this computer system, the user 
controls the position of the cursor 21 to point to an item and then to perform an 
5 operation with that Item by using the signal generation means, such as the 
button on the mouse, to signal to the computer that the item has been selected 
for an operation or to signal to the computer that a particular command has 
been selected by the user (in the case of the selection of commands from the 
menu bar 20 or representations of the command displayed elsewhere on the 
1 0 screen 22). The operation of pointing to an Item and selecting the item (or a 
command if a command is pointed to) Is well known in the art as a "point and 
click" operation. For example, to select the pile 23 shown in Figure 1 for an 
operation to be designated by the user, the user positions the cursor 21 over the 
pile 23 by moving the mouse 16 in an x-y direction to cause the cursor to be 
1 5 positioned over the pile 23 on the display screen 22. Then the user signals to 
the computer that the item has been selected by depressing and releasing the 
button on the mouse (causing the switch under the button to change from a first 
state to a second state and then back to the first state). Other methods are 
known in the art for selecting an item which is displayed on a display screen of 
20 a computer system. For example. It is know that an object (e.g. document) in a 
computer filing system having a graphical user Interface may be selected 
without pointing a cursor at the object by. for example, using the tab key on the 
keyboard to tab through' the various objects displayed on the screen. The 
currently selected object on the screen will typically be highlighted to convey to 
2 5 the user the fact that it is currently selected for an operation which is occurring 
or will occur upon further user instruction. 
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The user interface of the present mvention will now t>e described. 
Figures 2a. 2b. 2c and 2d show various embodiments of the graphical 
representations (e.g. icons) of the piles (or collections of documents) of the 
present invention. Rgure 2a shows the preferred embodiment of a graphical 
5 representation for a pile; this graphical representation 50 includes a base 52 • 
above Which are a collection of documents 53. Aocoiding to the preferred 
embodiment, each document in the pile represented by the graphical 
representation 50 may be a miniature of the first page of the actual document or 
an icon of the document type, a set of keywords related to the document ora set 
1 0 of attributes relating to the document. In this manner, the first page of the 
document serves as a proxy (indicia) indicating the content of the document, 
thereby providing the user with information concerning what the representation 
represents (l.e. what is contained within the document). Figure 2b shows an 
alternative embodiment of the graphical representation of a pile according to 
1 5 ttie present invention. The graphical representation 55 of Rgure 2b includes a 
collection of document icons which have been stacked together in a somewhat 
disheveled form to represent a pile or collection of documents. Rgure 2c shows 
apile which is similarto thai shown in Rgure 2b except less information is 
provided by each icon which represents a single document. Also note that the 
2 0 pile of Rgure 2c is disheveled, which tiie user may instruct the computer to 
portray when a pile is not organized by the system. Rgure 2d shows one 
graphical representation 57 of a pile which 1$ organized by the system and thus 
appears as a neat stack of docuihents as shown in this figure. A pile organized 
by the system as a result of a user or system supplied script could also appear 
2 5 organized (e.g. not disheveled). This is one possible representation of the 
attribute of having a script; other attributes Include the base having a texture, a 
pattern, some text on the pile, or an outline around the pile or an indication In 
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the name of the pile. The graphical representation of a pile may be either a 
dynamic graphical representation, as in the prefen-ed embodiment, or a static 
graphical representation, such as a typical icon used in computer systems 
having graphical interfaces. A graphical representation generally is any Hem or 
feature displayed on the display screen of the computer system." The dynamic 
graphical representation of a pile increases in height when a document is 
added to the {[rile and decreases in height when a document is removed from 
the pile. The icon for each document in the pile may be selected by positioning 
the cursor over the Icon in the pile. In the case of a static graphical 
representation of a pile, a document is selected based on a mapping of the 
height position of the cursor relative to the total height of the pile's graphical 
representation; that Is. the ratio of the cursors height above the base of the pile 
to the total pile height is mapped to the document's location in the |Mle. For 
example, a ratio of 1/4 (cursor is one-quarter up from base) maps to selecting a 
document which is one-quarter from the bottom of the pile which in the case of a 
pile with 8 documents Is the second document from the bottom. This mapping is 
similar to how scrolling boxes on vwndows operate and will be appreciated by 
those in art. 

Figure 2e shows hwo |Mles 63 and 65 having bases 64 and 67 
respectively on top of which are stacked graphical representations 66 and 68 
respectively, which graphical representations represent the collection of various 
documents in each pile which are stored in a memory (e.g. hard disk) by the 
filing system of the invention. Note that the pile 63 includes graphical 
representations of documents within the pile which indicate the thickness of the 
document relative to other documents. Alternatively, a different color could be 
used for various documents and a different texture could be used for different 
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documents to convey informatfon to the user. Thebase64of Fiflure2eandthe 
base 52 of Rgure 2a are each a means for selecting the entire pile or collection 
of documents for an operation on the entire pile (rather than an operation on an 
Individual document or group of documents within the pile). Operations on an 
5 entire pile Including moving a pile across the desktop on the display screen or 
opening the pile to show Its contents in a window. Other means for selecting a 
pile include a top means, such as the paperweight 54 shown on top of the pile 
56 in Rflures 2h and 21 (Figure 2h shows the pile in a 'closed- form where there 
is no viewing or browsing of documents in the pile and Rgure 21 shows the pile 
10 56 in an 'open' form with the papenveight 54 lifted to reveal the cursor 60 
pointing to a selected document 58). and a wrapper means, such as band 71 
Which wraps the pile 70 In Rgure 2j or the band 74 which wraps the pile 72 In 
Figure 2k and pile 73 in Rgure 2L The means for selecting effectively identifies 
the documents In the pile as a unified collection of documents. 

15 

Piles 63 and 65 are displayed in a mail window 61 which contains 
electronic mail documents received over a network system or other electronic 
mail system. It will be appreciated that the method and apparatus for organizing 
information fn the computer system according to the present invention has 
20 particular relevance to electronic mail and to other documents where the user 
does not know the content of the documents. In the case of electronic mail, the 
user will not typically know the content of a mail message received from another 
computer user (e.g. over arr electronic mail network system) and the computer 
system will typically collect mail documents from various other user's and 
2 5 accumulate them in a particular location (e.g. a mail window such a mail 
window 61) from which the user may find each mail message and read each 
mall message, "me automatic filing into piles andsubpiling and classification 
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methods of the present invention are particularly useful in this mail/message 
environment. For example, the user may Instruct the system to collect mail 
documents Into a pile and then have the system create subplles or search a pile 
of mail documents according to the Invention and then create subplles from 
5 documents found in the search. These various operations are described below. 

Operations and actions relating to piles will now be described. Figure 3 
shows three groups 101, 110, and 1 12 of documents which are related In time 
in that a user performs an operation as shown in group 101 and the computer 
1 0 completes the operation and shows the progress of the completion of that 

operation In groups 110 and 112. That Is, group 101 shows the action of a user 
in the computer system of the present invention and groups 110 and 112 show 
two successive stages In time of the response of the computer system to the 
operation of the user shown in group 101. 

15 

Figure 3 shows the process of creating a new pile where the user 
performs the operation shown relative to group 101. In particular, the user 
positions the cursor 106 over one document 105. selects that document and 
then moves that document (drags the document) over to the document 103 such 

2 0 that the document 1 05 and/or cursor 1 06 is posHioned over document 1 03, In 
this situation, document 105 will overlap document 103. Then the user signals 
to the computer to create a pile; in the preferred embodiment, this is 
accomplished by releasing the mouse's button which was depressed when the 
user selected the document 105. For a better understanding of the preferred 

2 5 embodiment of creating piles a more detailed description will now be provided. 
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The user positions the cursor 106 by using a cursor control device such 
as a mouse 16. The cursor is positioned over the document 105 and then the 
user signals to the computer that the document is to be selected by activating a 
signal generation means, which in the preferred embodiment occurs by 
5 depressing the button on the mouse to indicate the selection. While keeping 
the button depressed (which continues to indicate to the computer that the 
document is still selected) the user then uses the cursor control device (e.g. 
mouse) to move the cursor and the document 105 such that It is moved over the 
document 103. When the cursor is positioned over document 103. the user 
1 0 releases the mouse button which changes the signal presented to the computer 
indicating that the document 105 is to be placed in a new pile with document 
103. In this manner, a new pile is created having documents 103 and 105. 
Upon releasing the mouse's button when the cursor 106 is over document 103. 
the computer is thereby instructed to create a new pile/and a display of the 

15 computer reveals an animation indicating the process of creating a new pile. As 
shown in group 1 10, the animation by the computer includes a step where 
document 103 is rotated and slightly incBned while document 105 begins to be 
rotated and placed downwardly on top of document 103. At the end of the 
animation by the computer system, the pile shown in group 112 results 

20 containing documents 105 and documents 103 both of which are on top of the 
base 114. Typically, the separate graphical representations of documents 103 
and 105 will disappear from the screen leaving the newpfle on the screen. In 
the filing system of the computer, one way of filing documents into a pile 
includes placing documents 1 03 and 105 In a subdirectory which is designated 

25 as a type of subdirectory which is similar to the subdirectory that a folder 
represents. Other ways of managing documents in a pile will be evident to 
those in the art. This subdirectory is maintained in the conventional manner by 
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the filing system for the Information stored in the computer system (e.g. on the 
mass storage device). Other methods for aeating a pile may be employed. For 
example, the user may select two documents and then select a command, such 
as "create new pile" provided by the computer system which creates the pile by 

5 removing the separate graphical representations of the two selected documents 
and displays the graphical representation of the pile and then modifies the 
pathname of both documents to reflect the fact that they are now In a pile which 
Is a new form of a subdirectory or alternatively aliases of the documents could 
be added to the pile. The pathname. It will be appreciated is typically an 

0 attribute of a file, document or pile which Is maintained by the filing system. 
Alternatively, the filing system may provide the user with an empty base for 
placing documents thereon to create a new pile. 



After the pile as been created, the user or the system can perform 
5 numerous actions on the pile, and one such action Is referred to as browsing 
where the user views indicia of documents In the pile without opening the 
document or the pile. 

Figures 4a. 4b. 4c. 4d and 4e reveal various embodiments for browsing a 
0 pile according to the invention. The graphical representation of pile 151 is 
shown in Figure 4a as a collection of documents 153 which are stacked on top 
. of a base 152. The cursor 154 is shown as located on top of the collection 153. 
In the preferred embodiment of the present invention, the user positions the 
cursor 154 over the graphical representation of the pile and allows the cursor to 
5 remain posHloned over the pile for a predetermined period of time. After that 
predetermined period of time, the computer system displays a view cone 162 
with a proxy 161 In order to allow the user to browse through the documents In 
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the collecUon of documents comprising the pile. As shown in Rgure 4a. the 
view cone 162 points to or is connected on one side (the apex or smaller side) 
to the collection of documents, and the apex is positioned to correspond to the 
document which has been selected for viewing in the browsing environmem. : 
5 The other side of the viewing cone 162 shows a proxy 161 whichis. in one 
embodiment, a miniature of the first page of the document which has been 
selected for browsing. The cursor 160. as shown in Rgure 4a, has been 
positioned over this document which indicates that the proxy 161 is for the first 
document in the pile 156. The user may select any document within the pile by 
1 0 moving the cursor on top of a particular document in the pile 156 and sending a 
signal to the computer to select the document. Once browsing has been 
invoked and the view cone has been displayed, the cursor need not be 
positioned for a predetermined period of time over an item in order to matte the 
view cone and the proxy appear. In other words, once the system has been 
1 5 instructed by the user to allow browsing of documents within a pile, the system 
displays the appropriate proxy for the selected document in the pile on demand 
by the user without wafting for a predetermined period of time. Once browsing 
has been invoked, the user may quickly scan through the pile by moving the 
cursor up and down the pile: in this manner, each time the cursor comes to a 
20 representation of adocument in the pile, the system displays the proxy forthat 
document within the view cone 162. The left side (apex) of the view cone as 
shown in Rgure 4a originates from the selected document and the right side 
(base) of the view cone shows the specific proxy (indicia) relating to that 
document It will be appreciated that the view cone provides a means for 
2 5 indicating the position of the selected document in the pile when browsing the 
pile in that the apex points to the selected document. Browsing may be 
terminated by the user by moving the cursor away from tiie pile such that It is no 
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longer positioned over any document area of the pile. Including any documents 
stacked on top of the base which are associated with the pile. Browsing may 
also continue if the user positions the cursor over the base: In this case, the 
proxy may reveal the script of the pile or an internal representation of the pile 
5 rtself rather than of a document In the pile. 

In the preferred embodiment, the appearance of the proxy is dependent 
on the type of pile and the context of its use. For example. If the pile originates 
from an electronic mail system which accumulates documents In the pile, then 
1 0 the proxy 83 in the view cone 82 shown in Figure 4f for the selected document 
81 in pile 80 Is shown. This proxy 83. typically used for mail documents, 
conveys more Information to the user In the case of a mail document than a 
miniature of the document which the user probably has not seen. This proxy 83 
is generated by using the most characteristic words (e.g. "design, 
1 5 competition...-) in the document as Indicated by the document's internal 

representation, which is described below, and by using Information from certain 
fields (e.g. To". "Re", and "Date") contained in the document Other attematlve 
examples of proxies include the proxy 190 shown in Rgure 4e which might be 
used when the user has asked for Information about a document which Is 
2 0 relevant to the operation of the computer's filing system (e.g. the size of a file 
when placed on a disk, such as the mass storage of Figure 1). The appearance 
and content of the proxy may be provided by the application program which 
created the document, particularly in the case of the miniature of the document: 
this occurs when the computer's filing system provides a system call to the 
2 5 program which created the selected document (the conventional filing systems 
typically keep track of this information) and the system call is recognized by the 
program as a request for the proxy of the selected document, and the program 
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responds by providing the proxy to the filing system which proxy may have been 
previously created by the program by miniaturizing (e.g. pixel averaging or 
other methods known in the art for reducing resolution and size of an image or 
exaggerating characteristics of the document) the full-size reproduction of the 
5 document. 



Figures 4b, 4c and 4d show alternative embodiments for browsing. The 
browsing embodiment of Figure 4b graphically appears the same to the user as 
the embodiment shown in Figure 4a except that as the user moves from 
1 0 document to document while browsing (e.g. by moving the mouse up and down 
through the pile) the computer system makes a noise indicating movement from 
one document to the next document. This noise may be a simple click or the 
sound of a briefcase closing or some other sound which assists the user so that 
the user realizes there isa change from one document to the next. This is 
15 particularly helpful where the pile is tall and small movements of the cursor 
causes the view to change from one document to the next F^ure 4c showfs an 
alternative graphical representation of the browsing operation according to a 
particular embodiment of the present Invention. In this embodiment, the 
document 174 has been selected for browsing and a proxy 175 of that 
20 document can be seen atthe end of the view cone 176. The cursor 171 Is 
positioned over the selected document, document 174, and the documents in 
the pile 170 which are above the selected document are moved sOghtiy to the 
left and are shown as a collection of documents 173. The embodiment shown 
In Figure 4d. which has been labeled as pile 180 is similar to pile 170 in Rgure 
25 4c except that when browsing, no view cone and no proxy wHhin tiie view cone 
is shown to the user; in this situation, the proxy is typically a miniature of the 
document. In this embodiment, the colledlon of documents 173 above the 
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selected document during the browsing operation is moved above and to the 
left so that the user may see the selected document 174. 

Figure 4e shows yet another alternative embodiment for the browsing 
5 operation where. Instead of a proxy which shows the first page miniature of the 
selected document, the view cone displays system Information which is typically 
maintained in a computer filing system such as the title of the document 
(Gesture Annotation), the type of document (MacWrite II document), the amount 
of information on the disk controlled by the filing system, and the date the 

1 0 document was created as well as an icon which is a representative of the 

document. Note that In this embodiment, the view cone 188 emanates from the 
selected document and the collection of documents 185 above the selected 
document moves to the left and above of the selected document so that the user 
may see the document which has been selected in pile 187. Note that this pile 

15 1 87 of Figure 4e includes a base 1 86 and below that base is a rectangular box 
containing the name of the pile which has been given by the user. Typically, the 
computer system will prompt the user immediately after a new pile has been 
created In order to obtain from the user a name for the file. As will be described 
below, the system may automatically provide or suggest names for a pile. 

20 

The proxies which are shown within the view cone need not necessarily 
be a physical resolution reduction of the original of each page of the document. 
To refresh the user's memory about the document, certain features of the 
document may be exaggerated (e.g. if the document is a spreadsheet a grid 
2 5 may be exaggerated on the proxy to represent the spreadsheet). If the 
document contains a user created annotation, the annotation may be 
exaggerated Similarly, if the document contains a drawing, the image of the 
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drawing may be exaggerated by making it larger relative to the rest of the 
miniature. The user may select the manner In which the proxy appears. It will 
be appreciated that if a folder IS placed wHhIn a pile the proxy for the folder may 
Itself be the Icon of the folder or may be a representation showing documents 
5 vwthinthefolder(e.g,anlconofafolderisdisplayedwfthsmaIlerrco,K 

representing documents shown within the folder). The user may page through 
a particular document which has been selected dunng the browsing operation 
by using a command to Indicate to the computer to step through the pages of 
the document. In one embodiment, the user may use the left and right arrow 
1 0 keys on the keyboard to mstoict the computer to page through the document 
which has been selected during the browsing operation. The computer will 

then display miniatures Of each page as the user presses the left or right key. 
For example, starting from the first page of the document the user may press the 
right key three times in order to page through all pages of a four page 
1 5 document: having reached the end of the document afterthe third key press, the 
user may depress the left arrow key three times to get back to the first page or 
may select a new document for browsing by moving the cur:sor to a new 
document. 



20 



Alternative methods for scrolling through the pages of the pn,xy will be 
apparent to those in the art. including a thumb roller knob on the mouse 1 6 
which anows the user to roll the knob to scroll through the pages. 

It will be appreciatedthat many variations for the browsing operation may 
25 be produced according to the invention. 
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For example, browsing may only allow viewing of certain types of 
documents selected by the user. In particular. If the user selects a selective 
viewing mode, then only a user specified type of document (e.g. only 
documents containing drawings) is shown during browsing; for instance, if the 
user selects this mode and specifies that only documents containing a To" field, 
or documents containing a chart will be shown during browsing, then the user 
eliminates unnecessary Information by filtering, in effect, such information. 

Rgure 4g. 4h, 4i, 4j, 4k, 41 and 4m show another embodiment for viewing 
the contents of a pile, which in this embodiment results from a search of 
documents stored In said computer system. Figures 4g-4m show the 
embodiment over various stages of time, beginning with a user's request for a 
search of the term "Blackstone" in the documents stored in the system, as 
shown in Figure 4g prior to initiating the search. This embodiment may be 
performed in a pen-based computer system having a graphical user Interface 
controlled by a pen (or stylus Input) and touch screen which is sensitive to the 
placement of the pen or stylus on the screen. These computer systems are 
known and the pen provides both cursor positioning functionality as well as the 
selection functionality in one operatton; that is. the pen positions the cursor and 
selects an object with the same gesture/operation. 

As shown in Figure 4g, the user has Indicated to the computer that a 
search of documents In the system for a word is desired, causing the computer 
to display a find dialog box with the "start" button 1 27 displayed in front of a 
document 125. The user enters in the term "Blackstone" and then selects the 
"start" command by selecting the "start" button which causes the computer to 
search for documents containing the desired term. The computer displays, as 
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Shown m Figure 4h, a pile 129 which contains the documents found In the 
search, which may be perfonned according to the methods described below, 
and the computer displays the first document 128 In the pile. Note that the 
indicia (e.g. document 128) in this embodiment is a full-size reproduction of the 
document. Then the user, selects the next document in the pile T29 for viewing 
by selecting the next document in pile 129; this could occur by the user pointing 
the stylus Input device at the pile 129 or at the next document In pile 129. This 
action by the user causes the system to respond inftialiy with the image sfiown 
In Figure 41 and then with an animation where an icon 132 of the document 
which has been viewed lifts up from and away from the pile 131 and flips over 
as it moves away from the pile 131 to a location near the pile. This animation is 
shown in successive stages over time In Figure 4i, 4|. 4k, 41 and finally 4m. The 
next document which was selected from pile 129 Is shown behind the graphical 
representation of the pile 131 and behind the find dialog box. Rgures 4j. 4k. 41 
and 4m have not included the document 128 in order to save space in the 
drawings. In this embodiment, the system manages the pile for the user during 
browsing so that documents which have been viewed are put in a "viewed' 
subpife (containing the document icon 132 as shown in Rgure 4m) and 
unvlewed documents remain in the original pile 131. When viewing is 
completed the user may reassemble the original pile by adding the 'viewed' pile 
back to the original or may separate the Viewed* pile by removing these from 
the original pile. Without an affirmative act by the user, the 'viewed* subpile will 
remain part of the original pile after viewing of the search pile is completed. 

Note that in many of these browsfing operations the pile remains visible 
either in Its original form or in slightly modified form. This is unlike prior 
computer systems which have subdirectory "containers" such as foldprs which 
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might disappear or be obscured from view when the container is opened to 
view the contents of the corrtalner. That is. the user can maintain the context 
(e.g. the graphical representation of the pile and all other items on the desktop 
remain visible) of the filing system while browsing a pile unlike the situatton with 
5 examining folders in a typical filing system with a graphical user Interface. The 
proxy of the invention, with or without the view cone, may also be used with any 
icon or object on a desktop in a graphical user interface to pemiit 
browsingA^iewing of the icon or object without losing the context of the filing 
system. For example, browsing of the contents of a conventional foWer could 

1 0 produce a proxy for each document (or selected types of documents) within a 
folder, such as the foWer 312 shown in Figure 8a. In particular, the user 
positions the cursor over the folder for more than a predetermined period of time 
and, while the Icon of the folder remains visible, the proxy of a document 
appears next to the icon of the foWer. In one embodiment, the particular 

1 5 document selected depends on the mapping of the ratio of the vertical position 
of the cursor relative to the bottom of the folder to the location of the document in 
a nsting of the contents of the folder, in the same manner described above for 
browsing a static graphical representation. 



' 0 The operation of moving a pile will now be described by referring to 

figures 5a and 5b. Rgure 5a shows a graphical representation 201 of a pile 
with a base 203. As shown in Figure 5a. the user has positioned the cursor 204 
over the base 203. With the cursor posHioned over the base 203 the user then 
selects the pile and moves the cursor by manipulating the cursor control device 

5 while keeping the pile selected. In this manner, the pile follows the movement 
of the cursor and is moved around the display screen 22 of the computer 
system. In the preferred embodiment, the selection is indicated by using a 
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Signal generation means such as a mouse's switch to signer to the computer 
that a selection has been made at the location of the cuisorand moving occurs 
by keeping that switch In the same state while moving the mouse to move the 
cursor. When the user has moved the pile to the location which is desired, the 
5 userlndicatestothecomputerthatthemovelsover. Inthepreferred 

embodiment, the user refeases the switch's button on the mouse, which switch 
remained in a depressed state since the selection of the pile. At end of the 
move, the pile Is shown at the location where the user released the switch. 
Duringthe move, either an outline of the pile or a facsimile of the pile's 
1 0 graphical representation may follow the cursor around the display screen 22. 

The alternative embodiment of the move operation is illustrated in Figure 
5b. where the pile 205 does not have a base. The user positions the cursor 204 
over the pile 205 and signals to the computer that the pile has been selected for 

15 a move by depressing the moused button which causes the switch to change its 
state in the mouse. Then the user manipulates the cursor control device in 
order to move the cursor and the graphical representation of the pile or the 
outline of the pile follows the cursor until the user releases the mouse button in 
Older to deposit the pile at the desired iocatlon at the end of the move. 

20 

Adding an Item to the top of a pile is shown in Figure 6. RgureBshows 
the same pile at different stages in time of the oper^ion of adding an item to the 
top of the pile: spedficalfy, three stages or groups. 220. 221 and 222 are shown 
in Rgure 6. The initial stage 220 is the one in which the user Instructs the 
25 computer to add the Kern to the top of the pile, and stages 221 and222show 
the animation displayed by the computer system as a result of the users 
operation. In the first stage 220. the user positions the cursor 231 over a 
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document 230 and moves that document (in the well known manner of moving 
an icon in a graphical user Interface, such as the Macintosh finder) so that the 
cursor is positioned over the pile 224. When the cursor 231 is placed over the 
pile 224 and the system provides feedback to the user by highlighting the pile 
5 and then the user signals that the move operation for document 230 is over, 
then the system responds by Implementing stages 221 and 222 whtoh cause 
the document 230 to be added to the pile. Typically, the user will signal the end 
of the move to the document 230 by releasing the mouse's button while the 
cursor is positioned over the pile 224. The computer then responds as shown 
1 0 in stage 221 of Figure 6 by incfining and rotating document 230 to show the 
animation of placing the document 230 on the pile 226. At the end of the 
computers operation, (shown as stage 222 of Figure 6) the document 230 is 
shown on the top of the pile 228. The operation of placing the document on the 
pile is similar to the operation of placing the document within a foWer of a 
1 5 graphical user Interface filing system in a computer in that, in one 

Implementation, the pathname for the document which is maintained by the 
filing system is modified to include the name of the pile in the complete path 
name for the document The user can have gross or fine grain control over the 
placement of documents on the pile, as will be discussed In conjunction with 
2 0 Figures 1 la. 1 lb . 12a and 12b. 



The operation of adding an Hem to the middle of the pile will now be 
described by referring to Figure 7 which shows three stages in time 251 , 253 
and 255 for this operation. In stage 251 the user moves the document 256 ov€ 
to the pile 250 and positions the cursor (while keeping the document 256 
selected) over an inner zone of the pile 250. Further details regarding the inne 
zone of the pile will be described below with reference to Figures 12a and 12b 
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and partlculariy Rgure 12b. When the cursor 252 has been kept in the inner 
zone for a predetermined period of time then the computer responds by 
presenting on a display means 22 the graphical repraserrtation shown in stage 
253 which includes the pile 250 (now slightiy modified) and view cone 257 with 
5 a proxy 258 within the w'ew cone. The proxy shown within the view cone 257 is . 
of the document which is immediately below the document 256 and the cursor 

252. ftwiflbeappreciatedthatineffect.thabrowsingmodehasbeenacUvated 
and the user may move the cursor up and down within the pile to browse 
through the pile. In this operation, however, the mouse button is down 

1 0 (depressed by the user) as the cursor is moved up and down unlilte the 

browsing operation described above in the preferred embodiment As soon as 
the mouse button is released by the user during this operation shown in stage 

253. the document 256 will be deposited on top of the current item within the 
pile which is also shown within the view cone 257; The curremiy selected item 

1 5 may be changed by browsing up arid down over the pile by moving cursor up 
anddown over the pile. As shown In stage 253 of Figure 7, if the cursor 252 
were kept in its position shown in stage 253 and the mouse button released, 
thenthe document 256 would be plaoed on top of the foWer. the proxy of virhich 
is shown as proxy 258 within the view cone 257. This results in stage 255 in 

2 0 which the pile 259 is shown with the new document 256 added in the middle of 
the pile; the document 256 vwll have been added immediately above the folder 
the proxy of which Is shown as proxy 258 at stage 253 

In addition to browsing apile |n the manner described above, the present 
2 5 invention provides a method and apparatus for obtaining an alternate view of 
the contents of a pile; various embodiments for obtaining an alternate view are 
shown in Rgures 8a. 8b. 8c and 8d. In the embodiment shown in Rgure 8a. the 
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user obtains an atternate view of the pile by positioning the cursor 303 over the 
base 302 of the pile 301 and rapidly depresses and releases the mouse button 
turice. which causes the computer system to respond by making the pile 301 
disappear and making a region of the displcy screen, such as a window 304, 
5 appear containing contents of the pile spread out in the manner shown in 
Figure 8a. Other methods for obtaining this alternate view will be appreciated 
by those in the art. particularly by referring to the art relating to graphical user 
interfaces for computer filing systems. For example, the user may select the pile 
and then select an "Open" command from a pull down menu 20. As shown In 

1 0 Figure 8a, graphical representations of documents 310, 31 1 , folder 312, and 
documents 313, 314 and 315 are shown within region or window 304. 
According to the present invention, items in the pile are an-anged in a grid within 
the window 304 and top to bottom order of the pile is preserved in a left to right 
format. The standard window operations are provided by window 304 and the 

1 5 computer's operating system; these standard window operations are well 

known and are available in graphical user interfaces with windows, such as the 
Macintosh Finder from Apple Computer, Inc. of Cupertino, California. Thus, for 
example the graphk»l representations of the documents or folders within the 
v^ndow 304 may be moved within the window or moved outside of the window. 

20 or a document such as 310 or 31 1 may be moved into foWer 312, etc. The 
window 304 may be removed from the screen ("closing the window") by 
positioning the cursor 303 over the region 305 shown in the upper left hand 
corner of the window 304 and by depressing and releasing the mouse button to 
activate the operation of closing the window which then causes the computer 

2 5 system to revert back to displaying the pile 301 as shown in Figure 8a. 
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An alternative emtwdimerit for obtaining an alternate view of a pile 320 is 
shown in Figure 8b. in this embodiment, there is no base for the pile and thus 
the user cannot double dick on the base of the pile. Rather, the user must 
double dick on the pile itself which will cause the computer to remove the 
5 graphical representation of the pile 320 from the display screen means 22 and 
cause the appearance of the window 321 which contains the iconic 
representation to the various documents within the pile in a typical window for 
computer systems with graphical user interfaces. Other methods for obtaining 
an alternate view will be easily observred by combining the techniques of the 
10 Invention with the skiH of the art 

For example. Figures 8c and 8d show another embodiment for obtaining 
an alternate view of a pile. In this embodiment, the user moves the mouse 325 
In a manner shown by the arrow 327 (moving the cursor badt and forth in a 

1 5 horizontal fashion across the pile 328); This causes the pile 326 to be 

displayed in a spread out manner 330 shown in Figure 8d. After the computer 
displays the pile in a spread out manner the user may provide an instruction to 
the computerto redisplay the pile 326 in the stad^ed format shown In F^ure 8c. 
Note that this back and forth horizontal movement Is perpendicular to the 

20 vertical cursor movements (up and down a pile) to achieve browsing. 

Two different embodiments tor the operation of removing an item from a 
pile are shown In Rgures 9a and 9l> respectively. Figuro 8a shows one 
embodiment in three stages of time 350. 352, and 354. In stage 350. the user 
25 positions the cursor 351 over the desired item 355 a proxy 356 of which is 
shown within the view cone 357. The user win died( the contents of the view 
cone to determine whether or not the proper proxy is shown within the view 
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cone which will then tell the user that the cursor is on the proper/desired 
document. Browsing of the pile may be employed to find the desired document. 
At this point, the user moves the cursor 351 so that it no longer is over a portion 
of the pile as shown at stage 352; note that the view cone and the proxy are no 
5 longer shown at stage 352 because the cursor is no tonger over a region of the 
pile. The user continues the process by continuing to move the document 355 
away from the pile as shown in stage 354 and when the user has moved the 
document far enough away from the pile the document 355 appears in its 
upright orientation and is no longer slanted relative to the generally rectangular 
1 0 region of the display screen 22. In the embodiment shown in Figure 9b, in order 
to remove an item from the pile 360 the user must first obtain an alternate view 
of the pile-e.g. position the cursor over the pile and repeatedly press and 
release the mouse button twice ("double clicking") in order to cause the window 
362 to appear. Other methods for obtaining this alternate view will be 

1 5 appreciated by those in the art. particuarly by referring to the art relating to 

graphical user interfaces for computer filing systems. For example, the user 
may select the pile and then select an "Open" command from a pull down menu 
20. At this point, the user may use normal operations for graphical user 
interfaces having windows in order to remove items from the pile, in particular, 

2 0 the user positions the cursor 351 over the desired item 355 and selects the 

document and keeps the document selected while moving the cursor out of the 
window thereby moving the document with the cursor out of virindow 362. 



Two different embodiments for removing multiple items from a pile are 
shown in Figures 10a and 10b respectively. This operation in the case of the 
embodiment shown in Figure 10a is shown in three stages 401, 405 and 407 
which are three stages In time for this operation. The user begins the operation 
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in the same way as described for the browsing operation by positioning the 
cursor 351 over the pile 402 for more than a predetennlned period of time 
causing the view cone 357 to appear with Its proxy 403. The user then 
depresses the mouse's button to signal to the computer that the currently 
5 selected document (as shown in the wew cone with the proxy 403) is to be 
selected. Then the user signals to the computer that further items are to be 
selected; this is typically done by holding down a particular key of the keyboard 
or some other button to change the stage of the switch which is coupled to the 
computer system. In the preferred embodiment the shift key on the keyboard is 

1 0 held down while the cursor is placed on other documents which are desired. 
With the shift key down, the user may release the mouse button after selecting 
the first document and then press the mouse button down and release it to 
select additional documents. For each additional document which Is to be 
selected, the user positions the cursor 351 over the document and presses and 

1 5 releases the mouse button while also holding down the shift key. As shown in 
stage 405. this results in three documents 407 being selected from the pile. The 
user then positions the cursor away from the pile and continues to move the 
cursoraway. After moving the cursor outside of the region of the pile, the 
computer system causes the documents to revert to their upright non-incfined 
20 form as shown in stage 407. 

The operation of removing multiple items from the pile not having a base 
is shown in Figure 10b. in this operation, the user must first obtain an alternate 
view of the pile-for example, opening a window by double clicking the mouse 
25 button with the cursor 361 over the pile 360 thereby causing the window 362 to 
appear. Then the user selects multiple items in the well known manner for 
dealing with windows In filing systiems with graphical user Interfaces. 
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Rgures 2f and 2g show two different embodiments which utilize an outer 
zone and Inner zone for allowing the user to select between the creation of a 
pile where the user can control the appearance of the pile and the creation of a 

5 P»e where the user delegates to the system the task of placing the document 
neatly on top of a new pile. An inner zone 77 is contained within the interior of 
the circle shown over an icon of a document 75 in Rgure 2g. The inner zone 77 
is used to indicate to the computer system that the user desires to indicate to the 
computer system that the user desires to comrol the positioning of documents in 
1 0 the pile 80 that the appearance of the graphical representation of the pile Is. at 
least to the extent of the orientation of documents in the pile, controlled by the 
user. An outer zone 76 Is contained within the drcle shown over the Icon 75 
excluding the region in the Inner zone 77. That is. the outer zone 76 is an 
annular ring having two boundaries defined by the outer circle of Rgure 2f and 
5 the inner circle of Rgure 2g: this annular ring may be thought of as the 
subtraction of the area within the inner circle from the area within the outer 
circle. The outer zone 76 is used to indicate to the computer system that the 
user desires to allow the computer system to control the positioning of 
documents in the pile. The user may when adding one document to the pile 
0 use the Inner zone 77 to control positioning, and then when adding another 
document to the pile the user may use the outer zone 76 to allow the computer 
system to control the positioning of the new document in the pile. The circles of 
Rgures 2f and 2g would typically not be shown during use of the invention, and 
they are shown in these figures for purposes of illustration. The shape and size 
5 of the inner and outer zones is a design choice which may be varied to suit the 
user's desire. The operation of using the inner and outer zone will be described 
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by referring to Rgures Tia and 1 lb which use adifferent shape and size for the 
inner and outer zones. 

Figure 1 la shows the circumstance where the user, by using the outer 
5 zone, allows the system to neatly place the document on top of the new pile. 
andF^ure "b shows four stages of where the operation where the user 
creates a new pile and controls, by using the inner zone, the positioning of the 
documents in the pile and hence the appearance of the pile. In the embodiment 
shown in Figure 11a. the user selects a document and moves the selected 
10 document on top of the document 450 shown at stage 451 of Figure 11a. The 
document which has been selected is not shown at this stage in the figure in 
order not to obscure the outer and Inner zones of the document 450. The outer 
and Inner zones are not nomially displayed during the use of the Invention, and 
theyareshownlnRgures11aand11bforpurposespflllustrafion. Theuser. 
1 5 having selected a document posiUons the cursor 453 over the outer zone 452 of 
the document 450 as shown in stage 451. This is also shown at stage 455 
where the cursor 453 has been used to select dodument 454 and the document 
454 and the cursor 453 have been moved on top of the outer zone of document 
450. When the user releases the mouse button indicating that the document 
20 454 is no longer selected, the computer responds with animation as shown at 
stage 457 where the document icons 458 and 460 are Inclined and rotated and 
finany In stage 459 are shown deposited neatly on top of a base 461 as a new 
pile. TheopBrationofcreafinglhenewpllecausesthebase461toappear. In 
an alternative embodiment of the use of the outer zone 452. the user moves the 

25 selectedcfocumentovertheouterzone452ofthedocument450sothatat least 
a portion of the Inner zone (or some other central *hot spot") of the selected 
document (e.g. the Inner zone of document 454) is overa portion of the outer 
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zone of the document 450. Then the user indicates that the selected document 
is no longer selected (or that a pile is to be created) and the computer responds 
wHh the animation shown in stages 457 and 459 to create a neat graphical 
representation for the pile over the base 461 . 

The operation of creating a new pile while maintaining user control via 
the appearance of the pile is shown in Figure lib and proceeds in a manner 
similar to that described for Rgure 11a except that the user positions the cursor 
467 over the inner zone 466 of the document 450. Thus, as shown at stage 465 
of Figure lib, the cursor 467, after having selected a document and moving the 
document and the cursor while keeping the document selected, is positioned 
over the inner zone 466 of the document 450. This is also shown at stage 470 
of Figure lib where the cursor 467 is shown over the original document 482 
which is selected, and the cursor 467 is also over the inner zone 466 (not 
shown). Upon the user's reaching the inner zone of the bottom document icon 
450, the computer responds at stage 473 by IncBning and rotating the document 
icons and then by observing the position the user indicates by moving the 
cursor 467 relative to the bottom, document icon 481. As long as the top 
document icon is left touching the bottom document icon, the computer follows 
the positioning of the top document relative to the bottom document and allows 
the user to position the document at any location. If the user moves the cursor 
outside of the bottom document icon such at the top document icon is no longer 
touching the bottom document icon then the computer system reverts back to 
showing two separate document icons which are not inclined and rotated. 
When the user is satisfied with the position of the top document icon relative to 
the bottom document icon user releases the selection on the top document (by 
releasing the mouse button) which causes the computer to respond as shown at 
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Stage 475 by creating a pile having a base 461 with the top document aligned 
according the user positioning of the top document relative to t^^ 
documentas described pwvlously. In an alternate embodimem of the use of 
the inner zone 466. the user moves the selected first document over the Inner 
5 zone 466 of the document 450 so that at least a portion of the Inner zone (or 
some other central-hot spot") of the selected document 482 is over a portion of 

the inner zone Of the bottom document 450 for at least a predetermined period 
oftime. Thentheuserindlcatesthattheselecteddocumemisnolonger 
selected (or that a pile is to be created) and the computer responds with the 
1 0 animation shown in stages 473 and 475 to allow the user to po^on the top 
document 482 over the bottom document 450 in the manner described above. 

Figures i2aand12bshowtheouterandinnerzonedeslgns respectively 
forthe process ofadding an Hem to aplle. The Inner and outer zones are 
15 shownlnRguresl2aandl2bforthepurposeoflllustration. The operation of 
adding to the pile and allowing the system to control the location of the new 
document, as shown In Figure 12a. is similar to the operation described relative 
toRgurella. In particular; the user selects a document and moves the 
document over to the pne and positions the cursor 503 (or alternatively the inner 
2 0 zone/hot spot of the selected document) In the outer zone of the pile as shown 
In stage 501. As shown in stage 505. the document 506 which has been 
selected and moved along with cursor 503 is positioned over the pile and the 
cursor 503 is positioned in the outer zone. Upon releasing the selection of the 

document while the document and the cursor is positioned over the pile and 
25 particulariy the cursor Is positioned over the outer zone, the computer responds 
at stage 51 1 by incfining the document 506 as It is positioned by the system on 
top of the pile. At stage 514. the operation is complete as the icon 506 Is shown 
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on top of the graphical represenlation of the pile, which representaUon is 
dynamic as illustrated In the figures. The operation shown In figure 12b allows 
the user to add a document anywhere in the pile. This is accomplished by 
selecting the document and taking the document with the cursor 517 and 
positioning the cursor (or alternatively the inner zone/hot spot of the selected 
document) over the pile and particularly over the inner zone 516 of the pile 
shown at stage 51 5. After a predetermined period of time, the computer 
responds as shown at stage 520 with the view cone 518 and the proxy 51 9 
within the view cone, which proxy shows the document immediately underneath 
the current location in the pile which the user has selected by placing the cursor 
517 (or alternatively the inner zone/hot spot of the selected documerrt) into the 
inner zone. If the user is satisfied with this location the user releases the 
selection by typically releasing the mouse button on the mouse causing the pile 
appear as shown at stage 525. 

The invention provides a method for the user to include a user defined 
specification, such as a script, for a pile. A user defined specification may be 
provided by the user (e.g. typing keywords as a specification or selecting a 
sample document, having an internal representation which is described below 
and which provides the specification) or may be suggested by the system and 
ratified by the user. Normally, the user can control whether a pile has such a 
spedfication and thus the system vkdll not create such a specification without the 
user's approval. Not every pile needs or will have a user defined specification, 
although every pile will have an internal representation (described below) or a 
user defined specification. 
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A tool for visualizing and organizing the contents of a pile will nowbe 
described by referring to Rgure 13a and I3b. A pile 550 is shown within the 
Visualization Window 551 of Rgure 13a. Typically, the user would select the 
pile 550 and then select a command from the computer which would Invoke and 
5 tfsP'ay this vIsualizaUon Window With the selected pile 550 within 

551. The window 551 Includes several command options which allow the user 
to view the pne in different ways and to orderthe contents of the pile in different 
ways and to select between those different ways in order to obtain different 
appearances of the pile orto olhenvise reorganize the pile (e.g. create subplles 
10 from a Single Original pile). For example, by placing the cursor over the arrow 
Icon 555 and by selecting the Icon 555 by depressing the mouse button or 
othenvise signalling to the computer to select the arrow icon 555. the user 
causes the computer to display a pull down menu Indicating the various ways in 
Which the contents of the pile may be ordered. The system shows in box 556 
1 5 that the pile is currently ordered by date which means either that the most 
recentitems are on the top or the oldest items are on me top dependlnfl on the 
designer's preference. Other options which may be Included in the "order pull 

down menu (achvaled by selecting arrow 555) may indude: ordering b^ 
content: ordering by size: ordering by author (alphabetically). The operation of 
2 0 the pull down menu is well known in the art and has been described for 

example in U.S. Patent Reissue 32.632. The arrow Icon 560 allows the userto 
sefecl the way In which the pile is colored. As shown In box 561 thesystem 

currertly has colored the pile by date in which, in one embodiment, the mosi 
saturated shade of a color is displayed near the bottom of the pile (indicating 
25 the older documents) then the top of the pile has a lesser s^urated shade of the 
same color. It will be apparent to those in the art how to Implement this function 
by assigning colors: for example picking a color In a perceptual color space 
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(e.g. Munsell color space) and varying the saturation of the color holding the 
luminance constant and the hue of the color constant The range of the dates 
would be used to set the outer limits of the saturation. That Is, the oldest and 
most recent documents would form the extremes of the saturation range and a 
date In the middle of that range would specify a color in the middle of the 
saturation range. 



Other ways of presenting various colors according to a measure of the 
date/age of the document will be appreciated l)y those in the art. particularly by 
referring to art relating to color management systems in computers. For 
example, the hue may be varied (e.g. from red to blue) while keeping a constant 
saturation and luminance. Alternatively, preselected colors (and the color 
values) may be used In a look-up table for mapping the measure of date/age of 
the document to one of the preselected colors in the took-up table. 

In a similar manner, the user may desire to view the color of the pile 550 
according to the content of the pile. This would be done by the user selecting 
the arrow icon 560 to cause a pull down menu to appear below the arrow icon 
560. which pull down menu would include the command option of "coloring by 
content- The user would then select this command option placing the cursor 
over that command option and releasing the selection (e.g. by releasing the 
mouse button) which then causes the word "content* to appear within the box 
561 indicating that the system will color the pile by content This will be 
described in more detail below particularly with reference to Figure 20. 

The visualization window 551 also includes an arrow icon 565 which 
activates a pull down menu to allow the user to select the manner in which the 
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pile IS organizecf (e.g. -pile by content"). As shown in Figure 13a. the user has 
selected "pile by content" which may caiise the system (depending on how 
related all documents are wrfthin the pile 550) to create subpiles from this pile 
550. The user could have selected other opUons available in the pull down 
5 menu from icon 565. such as, "pile by date." -pile by stamps." "pile by data type-, 
-pile by source." etc. Let us assume that pile 550 is a pile of mail messages 
obtained through electronic mail which the user has moved out of a mail 
window such as window 61 and has selected this pile for visuafization in a 
visualization window 551. Because it is a mail message pile, ft is fiicely that the 
1 0 contents of the various documents in the pile will vaiy over a large range and 
that the pile would be better organized into several subpiles according to 
content. Accordingly the user has placed the pile into the visualization window 
551 anddesiresto^le^ooment.Mhatis.lheuserdesirestoma^^ 
from the original pile. The user does this by sele^ngaconun^^ 
1 5 that the pile should be pttedby content In thTembodiment shown in Rgure 
13a. the user selects this by selecting the " atroW button 565 which the user 
may do. for example, by placing the cursor over the region of the button 565 and 
pressing and releasing the mouse button or by othenwise signalfing to the 
computer to matce this seiecUon. Upon making the selection, visuafization 
20 window 13b appears wherein three organized piles 575. 576 and 578 are 
displayed along with a miscellaneous pile Cother) 577. The ^stem has. in 
addiUon to creating the subpiles. provided a name for each pile fn the manner 
described below, particular with reference to Rgure 15. Atthis point, the user 
may instruct the computer system to infer a user defined specification, for 
2 5 example, a script, from the system created subpiles which could then be used to 
automatically file new mail documents received over the electronic malt networi< 
into one of the subpiles according to the particular script of the subpile The 
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system infers the script by using the system provided internal representation of 
each subpiie; for example, the 'N' (where N is an integer) most characteristic 
words In the pile's internal representation (e.g. the pile's vector described 
below) could be used. The user could then review the fist of the 'N' (set by 
5 some system threshold value) most characteristic words and approve or 
disapprove of ail or some of these words and then create the script. More 
details concerning scripts will be presented below wHh reference to Rgure 14. 

The piles in Figure 13b were created from the original pile 550 by 
1 0 allowing the system to create the subpiles as described in the manner below. In 
this way. the user of the computer may more efficiently review the various mail 
messages and other documents within the original pile rather than having to 
browse through the pile to see the keyword proxy of Rgure 4f or othenwise 
select documents from the original pile. Thus, for example, if the user is most 

1 5 interested^in -art. design^too^ the user may begin looking at 

documents in that pile first and defer examining the other subpiles or perhaps 
the "notebook computer pile depending on the interests and priorities of the 
user. As will be described in more detail, the system analyzes each document 
Inthe original pile based on the content of the document and then determines 

20 the most appropriate subpiie in which to place the document Each subpiie will 
have a representation of the content of the documents within the subpiie and 
that representation will be compared against the representation provMed by the 
system for the particular document. The ctoser the match between the two 
representations and the more likely the particular document will end up in the 

2 5 particular subpiie. 
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If the user is satisfied with the results of the subpiling process shown in 
Figure 1 3b. the user may retain this structure by selecting the "Ok" button icon 
571. Otherwise, the user may cause the documents in the subpiles to be 
reassembled Into the original pile 550 by selecting the -Revert" button icon 670. 

5 iftheusBrselects"Ok"58l.thefillngsystemcreate8anewplleforeachsubplle,- 
which in one implementation invohres changing the pathname of each 
document in each subpllei in the manner described above. 

Figure U shows another tool, a script window 601 . for manipulating piles 
1 0 which have a user defined spedficatlon (e.g. a script) and controlfing the way 
they worit lit the computer system. The user may obtain the window 601 or 
other windows for creating and/br editing scripts in various ways, such as 
providing a command to the computer to display such a window on a display 
screen 22 (e.g. a 'Create script" command) or adding a documerit to a pile that 

15 already contains a script where the document's content does not match the 
script in a dose enough way and where the system has been Instructed to so 
notify the user when this occurs. In either instance, the script window 601 
appears on the display screen 22. If the window was invoked by adding an item 
to a pile and the user does not mind that the content of the document does not 

2 0 precisely match the script of the pile, the user may select the command "just add 
this Item" by selecting this command in the various ways known to select the 
command in a graphical user interface. This would typically take place by 
posiUoning the cursor near the button icon 602 and selecUng this command 
while the cursor Is posftioned over the button 602. If the user desired to modify 
2 5 the pile's script to accommodate the new document which was added then the 
user may select this option by placing the cursor in the button 603 and selecting 
that option (e.g. by depressing and releasing the mouse button while the cursor 



PCT/IIS93/(I2878 



45 

Is held over button 603). As shown in Figure 14. the user has selected the 
option of mocfifying the pile's script. 

The script window 601 as shown in Figure 14 has appeared atterthe 
5 user attempted to add a text document from Richard Mander (dated April 1 9. 
1991 and regarding design competition update) to a pile having a script. Since 
the documenrs representation did not match in a close enough manner the 
criteria of the pile's script, the computer displayed the window 601 . The script of 
the pile to which the Richard Mander document was added can now be 
1 0 modified by selecting various options within the script window 601 . The region 
605 of window 601 contains three check boxes 607. 606 and 609. If the user 
selects any of these three check boxes this will instruct the system to modify the 
script to cause the system to collect into the pile items "from Richard Mander or 
Items "dated April 19, 1991- or items "regarding design competition update". 
1 5 depending on which option or options are selected by the user. For example, if 
the user selects the option to collect ftems from Richard Mander then the 
computer system searches the filing system for documents containing a from" 
Jine or field indicating that Richaid Mander is the author of the documem or an 
author of the document Similarly, if the user selects the option of collecting 
2 0 items which are dated April 19. 1991. the system will collect documents which 
are dated April 19, 1991 into the pile whteh is controlled by this script. Typically, 
the user will select any of these options by manipulating the cursor control 
means to posHlon the cursor over one of the check boxes and then by selecting 
the check box, which may occur by depressing and releasing the mouse's 
2 5 button. Thus, for example. If the user wanted to pull all documents into the pile 
which have a regareling line "design competition update" then the user wouW 
position the cursor over the check box 609 and select that option by depressing 



wo 50/22738 



Per/US»3/02878 



46 



and releasing the mouse button. This causes the system (after the user selects 
the command) to pull in an documents Into the pile controlied by this script 
which contain "design competition update- In the regarding line/field of the 
document In this manner, the system may automatically classifylnformatlon for 
5 the user and the user may instmct each pile separately according to the needs 
and criteria of the user or the basis of a user defined specification. 

Region 61 1 of the script window 601 contains a list provided by the 
^rstem Which indicates the most unique used words in th^7ute7doiument 
1 0 from Richard Mender {i.e. the document which was added to the pile and then 
caused the system to display the script window 601 on the display screen 22). 
As will be described below, the system can provide a ranked fist of the most 
frequently used words in a document which also best characterize the 
document relative to all other documertts in the file system of the computer. This 
1 5 is done by the use of. in one implementation, the vector described below for the 
document, inthis implementation, each word listed In region 611 is one 
component of an n dimensional vector which describes the document and 
provides a representation of the contents of the document. As shown in script 
window601.the word "design" Is the most characteristic word followed by 
20 "competition- and -interface-. The system provides this fisting in region 611 and 
the user may scroll through the various words In this listing by selecting the 
scroH arrows 627 and 628 or by using the scroll bar 629. Thescroffing of the 
contents of region 61 1 1s accomplished in the normal manner of the prior art. 
The user may select any one or all or some of the words In region 611. When 

25 these words are selected, they appear In region 612indfcating to the system 
that the pile's script should be modified such that the representation of the pile 
(e.g, the pile's vector), as described below, is modified to take into account the 
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words selected by the user. Alternatively, the user may type words into region 
612 to thereby modify the script of the pile. In this manner, the script of the pile 
Is modified to take Into account the new document from Richard Mander which 
was added to the pile by the user before the script window 601 was displayed. 
5 For example, the user could select "competKion- and the word "children- and 
these words would then appear In region 612; wfjen ^e user selects "add to 
script- button 620 this causes the system to update the script for the pile causing 
the internal representation of the pile to be modified in order to allow the user to 
control the way the script behaves in the computer system. The selection of the 
1 0 words in region 61 1 may be accomplished in any of a number ways which are 
famlBar to user's of computer systems having graphical user interfaces (e.g. 
positioning the cursor over a word and selecting the word or "shlft^lcking" to 
select multiple words). 

15 In a simitar manner, the script of the pile may be modified to take Into 

account labels which specify certain criteria such as label 614 shown in region 
630. These Jabels contain certain "canned" criteria specified by the user and 
the user may select these labels by positioning the cursor over the particular 
label and selecting the label causing the icon of that label to appear in region 

20 61 7. These labels may be the programmable user Interface elements 

described in the application having serial number 07/700.729 which was filed 
May 15. 1991 and Is emitted "A User interface System Having Programmable 
User Interface Elements" and is assigned to the assignee of this appfication. 
These labels provide a programmable means for causing the execution of a 
2 5 series of Instructions and may include, for example, a requirement that all 
documents in a pile be dated after a certain date. 
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Once the user has determined and selected the various criteria which are 
to be used to modify the Internal description of the pile (pile's script) then the 
user may Indicateto the ^stem that the script should be modified by selecting 
the -add to script- button 620 and then by selecting the okay button 623 which 

5 <^"sestheexecutlonpfthescriptwhereinlhesysternchecksfordocuments 
managed by the fifing system Which match the modified script. Iftheuserdoes 
not like certain criteria which have been previously selected, the user may 
cancel the selection by selecting the cancel button 625. If the user selects the 
"script..." button 62f the system provides a window for the user to type in words 

1 0 or other criteria which will then be used to modify the script of the pile. This 
modified script may then be selected by selecting the add to script button 620 
and Okay button 623. « the user has requested a script window similar to 
v«ndow 601 miem adding to a pile, then the user desires to modify the script 
of the pile: this is accomplished by entering commands Into a script window In a 

15 manner similar to that described for window 601. 

The manner in which the filing system of the computer takes irtto account 
the representation of each document and each pile and perfbmis the various 
operations with plies which have been described above, will now be described 
20 by referring to the various flowcharts of Figures 15 through 21. 

Figure 15 shows one method according to the present invention for 
creating the internal representation used by the filing system in organizing piles. 
Which infernal representation is for each document in the filing system (or for a 
certain selected group of documents as specified by the user) and for every pile 
maintained in the filing system (or for piles which have been selected by the 
user to have their Internal representation determined). Typically, the filing 
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system will perform this operation for every documert (usually user documents 
not system documents such as operating system files) and for every pile In the 
system. If the filing system is using the method of the imrention for the first time 
then the method shown in Rgure 1 5 must be applied to every document In the ' 

5 that is. every document in the system must be treated as a new 

document. The method 700 for indexing documents begins at step 701 which Is 
merely a node point In the process. The first operational step of the system 
involves a test for whether the document Is a new document at step 702 A 
modiHed document is considered a new document as well as a new document 
1 0 which the user creates or which comes Into the user's computer system via 
electronic mall. It is also noted that a document that is deleted affects the 
internal representation of all other documents In the system and the designer of 
systems using the present Invention may want to eventually (e.g. in background 
processing on the computer system) recompute each document's vector and 
15 eachpile'svectorlnthlscircumstancealso. If there Is a new document In the 
computer system processing proceeds to step 703 In which the computer 
system counts the number of times certain ^r6s are used In a document. Only 
certain words are counted because many words (e.g. the. It. a. and. etc.) are 
used too commonly and would not provide a good internal representation of the 
20 contents of any document. Therefore, these words (referred to as "stop words") 
are discarded in analyzing and indexing documents. This may be 
accomplished by the system establishing a "stop word" table which is examined 
for each word In a document which Is being indexed. The system should also 
-stem- each word being indexed in order to prevent unnecessary redundancies 
25 between the singular and plural of a word (e.g. -horse" and "horses") and 

different tenses of a verb and other techniques which are known in the art may 
be applied for stemming the words (e.g. child and children wouW be considered 
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the same word). During indexing of each document, the system adds 
(non-stop) word to a table of unique words for the document or If the word is 
already in the document's taWe the system increments the count component for 
that word in that table. It will understood that this table win be maintained for a 
5 document during indexing and the table contains an Index to each non-stop 
word in the document along with acountof the number of times the word 
appears In the document The Index typically refers to (indexes) a global 
document frequency table which contains a list of all non-stop words used in all 

documents managed by the filing system of the present Invention. Also during 
1 0 indexing a document in step 703. the global document frequency table is 

updated in the following manner. Thai is. step 705 is typically perfonned at the 
same time as step 703 although It need not be. For each unique word in a 
document the system adds the word or Increments the count for the word in the 
global document frequency teble but only forthe first time the unique word is 
1 5 found in the document This global document frequency table is maintained for 
all documents in the system which are to be Indexed and shows the number of 
documents In the system which use the particular word. If during indexing a 
unique (non-stop word) is found which Is not in the global document frequency 
table then the word Is added to that table but only forthe first time the word is 
20 found In the document. That Is. subsequent uses of that word In the same 

document will not cause a modification of the global document frequency table. 
If thai me word is found In another document then, during Indexing of that 
other document, the system increments the count for that word In the global 
document frequency table, thereby Indicating that the word is contained In two 
25 documents. 
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After indexing a new document, step 703. processing proceeds to 
determining the number of documents in the system (documents which are 
previously indexed) which use each of the certain words in the new document. 
This is determined by examining the global document frequency.table. which 
5 may be a hash table, for each word in the document which has been indexed. If 
all documents are new in the system, a special initialization process which is 
accomplished In two phases must be performed in order to properly index all 
documents In the system, in the first phase, word frequencies are computed for 
all the documents; In other words, step 703 is performed for each document In a 
system and then the global document frequency count table will then be 
completed. In the second phase the document vectors are calculated, which is 
shown as step 707. for each document in a system. Step 704 performs, in 
effect, this two phase Initialization process by forcing step 703 to be repeated 
when system initialization occurs; step 703 is repeated until all documents are 
Indexed and then the global document frequency table is completed. System 
initialization may be determined by searching for the global document 
frequency table; if it exists when a new document is indexed in step 703 then 
the system has been inHiafized and otherwise the system has not been 
initialized and initialization proceeds until all documents are indexed in step 
2 0 703. 



10 



15 



In step 707 the Internal non-normalized representation of a document is 
determined by calculating the document's vector. This Is done by determining, 
for each of the non-stop words in the document the ratio of the number of times 
the particular word in the document is used nr-obtained from the document's 
table) divided by the number of documents in the system with the same 
particular word (-df""Obtained from the global document frequency table). This 
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ratio is sometimes referred to as the term frequency ftO of the word divided by 
■ the document frequency df of the word (tf/df). This ratio provides a weight for the 
particular word for this document as shown in step 709. Typical^ tliese 
individual weights are normalized in the manner shown below. Then the 

5 system win typicallyson. in step 711. the nomrallzed weights of a particular 
document to select a predetermined number of strongest normaFized weights. 
The vector for the document Is the collection of the predetermined number of 
strongest normaHzed weights. In a typical embodiment. 50 to perhaps an 
unDmited number of the strongest weights (which represent 50 to an unlimited 
1 0 number of the most characteristics words of the document) would be used for 
the document's vector. If an unlimfted number of weights is used, the system 
wni tend to operate slower. At this point, the system has the information 
necessary to display the proxy shown in F^ure 4f (used in the case of mail 
documents) because the most strongest weights identify the most characteristic 
15 words in the document, and it is these words which are displayed in this proxy 
(together with, if desired, words in preselected fields of a document, such as 
To", etc.). At step 717. the system determines whether the new document Is 
part of a pile, if it is not processing loops back to node A pOl) which is a 
waiting node in which the system waits for a new document in the filing system 
20 of the computer. If the new document is part of a pile then processing proceeds 
to step 719 in which the internal representation (e.g. a vector) forthe pile is 
determined. This representation may be iany one of several possible types. 
Including the average of aU document vectors in the pile (which is 
representative of the internal context of the pile) or the pile's representation may 
25 be designated by a script as described above or designated by a sample 

document O-e. the pile's vector is the same as a sample document's vector) or 
the pile's vector may be designated by certain key words having user 
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established weights. It will be appredated that if the method 700 for indexing a 
document is being performed during initialization of the system then the 
determination of a pile vector will occur after all documents have been indexed 
and the global document frequency table has been completed. After step 71 9. 

5 processing loops back to node A wherein the system waits for an intermpt or 
other messages Indicating a new document has been placed Irrto the filing 
system of the computer. 



The methods employed in steps 703. 705, 707, 709 and 71 1 are loiown 
1 0 in the art and various ways of determining an internal (or content) 

representation of a document are available In the infonnatlon retrieval art. See. 

e.g. Term-Weighting Approaches in Automatic Text Retrieval." G. Salton and 

C. Buckley, information Processing k Magfigpnipnt VoL 24. No. 5. pp. 513-523. 

1988. However, these methods have not been used in the context of piles as 
1 5 described in this Invention. In one implementatton of the invention, the 

normalized weight for a particular word (Iwi") in a particular document is 

determined according to the formula: 



20 



tw = 



where: 



N = total number of documents in the filing 
system which are selected for Indexing 
^ ^ (default selection is all user documents); 
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Hi = df for the word T (df is document frequency 
for word T from the glot>ai document 
^ frequency table) 

tft= tenn frequent for theW non-stop word in 
ttie particular document 

a= numberof unique non-stop words in tiie 
particulardocument(l.e. the number of 
components in the vector for the particular 
document) 

ni = the df for the particular word having its 
normalized weight being determined 

tft s tr (term frequency) of the particular word in 
the particular document: twi is the 
normalized weight for this particular word in 
this particuiar document 

Other implementations may be used according to the needs of the 
system designer. 

25 Figure 16 shows a method for perfomiing the operation of browsing of a 

pile. From node E, the system begins at step 751 , in which the system 
examines the location of the cursor and determines whether or not it is pointing 
to a pile. It will be appreciated that the system will typically monitor the position 
of the cursor in any one of the many ways known to those in the art. If the cursor 

30 is not pointing to the pile processing loops back to node E. If the cursor is 
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pointing to a pile then processing proceeds to step 752 in which the computer 
determines whether the cursor has continued to point to a document on the pile 
for a predetermined period of time. If not (e.g. cursor moved away from pile) 
processing loops back to node E In which the system continues to monitor the 
5 position of the cursor. If the cursor has pointed to a document on a pile for a 
predetennined period of time then processing proceeds to step 753 in which the 
system arranges the pile for viewing. This step may involve nothing or it may 
Involve shifting a portion of the pile as shown in Figure 4e. Processing then 
proceeds to step 755 In which the view cone is shown and a proxy of the 
0 selecled document in the pile is displayed. Then the system continues to 
monitor the posfUon of the cursor to determine whether the user has pointed to 
another item in the pile (step 757). If this is true, processing loops back to step 
753 to arrange the pile for viewing (e.g. pile is re-arranged to reflect a new 
shifted portion) and processing continues to step 755 In whteh the view cone 
5 continues to be displayed and a new proxy of the new selected document is 
also displayed In the view cone. If the same document is still being displayed 
because the pointer has not moved away from the document processing 
proceeds from step 757 to step 758 In which the computer determines whether 
or not the user has signalled to the computer to page through the selected proxy 
0 to the extent the proxy has multiple pages. If not. then processing goes to step 
760: otherwise processing proceeds to step 759 in virhich the system shows the 
desired page of the multiple page proxy In the view cone on the display screen 
22. Since the computer continues to monitor the position of the cursor and the 
status of the mouse's button, the computer system continues to determine 
> whether the cursor is pointing to the pile (step 760); if not processing toops back 
to node E and othervwse processing loops back to step 755. 
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As noted above, the system pro\rtdes various automaUc or us^^ 
actions on piles in order to assist the user in organizins the documents stoi^d 
stored in the user's filing system on the computer. The various ways in which 
the system of the present Invention performs these functions will now be 
5 describedwithreferencetoFigurel?. Fflure178howsthreedisUncl 

processing flows from three nodes (G.G1 and G2J. It will appreciated by those 
In the art that any of these nodes may be entered into on the basis of an 
intermpt provided to the system or some other user action so that entiy may 
occur into the flow chart pf Figure 17 at any node point, such as node point G. 
10 Gl.orG2dependingontheactionbytheuser. Processing begins from node G 
at step 801 which determines whether or not the user has given a document to 
the system to file in existing piles. This may occur by the user providing a -put 
away- instruction to the filing system after selecting a document to be put away. 
If this occurs, then processing proceeds to step 803 in which the system 
1 5 attempts to find a pile with the closest pile vectorto the document's vector and 
places that document in that pile. This Is typically done in such a manner that 
the similarity between the eonterit of the document and content of each pile is 
determined. In a typical embodiment this similarity is determined by computing 
the unit dot product of the pile's vector and thadocumerifs vector. A ^em or 

20 user supplied predetemiine threshold may then be used to compare against 
each dot product and the highest dot product above the threshold will Indicate 
which pile to place the document Into. Alternatively, the document (copies 
thereof) or aliases (pointers) thereof rhay be placed into all piles which produce 
dot products with the document's vector which exceed the preselected 

25 threshold. It should be notedthat step 803 could be performed automatically by 
the system for any new or modified document if the user so instmctsthe 
computer system to perform this function automatically. That is. the user may 
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instruct the filing system on the computer to always be active In putting away 
documents Into piles rather than doing this only when specifically invoked by 
the user (e.g. a "put away* command). An example of a method for determining 
a measure of similarity will now be provided. Consider a document vector and 
5 a pile vector shown below: 



Document Ve(5tor 


Pile Vertor 






index 




5 


0.1 


5 


0.2 


27 


0.2 


16 


0.17 


503 


0.15 


257 


0.17 


600 









Each index may be a pointer/index to an entiy to the global document 
1 5 frequency table where the Index "5" is for one word in the table and index "27 is 
for another word in that table. Note that in this example there is only one word 
(non-stop word) which is common between the document's vector and the pile's 
vector. The dot product, which is a way to measure the similarity between the 
content of the document and the content of the pile, for this example Is 
2 0 determined by searching for matches in the indexes (e.g. index 5) and 

multiplying the tw's for each matched index. In this case, the dot product is: 
0.1 x 0.2 a 0.02 since there is only one match. This dot product may then be 
compared to other dot products showing the similarity between the document 
and other f^les. 

25 

Step 805 is performed any time after entry from node g1 . In step 805, the 
system detennines whether or not the user has given the system a sample 
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document which should be used in order to start a pile. If not, processing 
proceeds to node g2. If the system has been given a sample document and 
been instnicted by the user to start a pile on the basis of that 'seed* document, 
processing proceeds to step 807 in which the system uses the vector of the 
5 sample document to find all documents which are closer than the preselected 
threshold based on the Internal representaHon of each document, such as the 
document's vector. Copies or aliases of such documents are stored in the pile 
which was created from the sarhple document 

1 0 Step 809 may occur from an internipl to the system or a command to the 

system; this Internjpt may occur from the action of adding a document to the pile 
when the user has instnicted the system to monitor the addition of documents to 
a pile having a script where the Internal representation of the document does 
not match the criteria of the script of the pile. As an alternate embodiment, the 

1 5 user may instruct the computer to observe the "cohesion" of each pile (whether 
or not the pile has a script) and indicate a warning to the user that a newfy 
added document to a pile does not match in a close enough manner 
(determined by a similarity measurement being compared to a preselected 
threshold), which warning gives the user an opportuitity to remove the 

2 0 document from the pile. It is notedthat the user could actual^ instnict the 

computer to ignore any such steps which in effect results in an automatic "no" to 
the decision made at step 81 T. If the user has instmcted the firing system to 
monitor the addition of documents to a pile having a swipt, then step 809 will be 
invoiced when the user adds a document to such a pile which does not match 

25 the document. In other words, the script of the pile does not closely match the 
Internai representation of the document. If this occurs processing proceeds to 
step 81 1 in which the system displays a dialog box or window to the user asking 
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the user whether the pile's script, should be modified. This dialog box or 
window may be similar to the window 601 shown In Figure 14. If the user 
Indicates that the pile's script Is to be modified, processing proceeds to step 813 
In which the system displays existing criteria and/or the script for the pile. 
5 Alternatively, the script and criteria could be displayed in step 81 i with a 
decision box requiring the user to decide whether or not to just add the 
document to the pile or modify the pile's script. At step 815. the system displays 
proposed script/criteria changes to the pile's criteria or script. This is shown in 
Figure 14 by the words found In the Richard Mander document which are 

1 0 shown In the region 61 1 or by the Items in region 605 such as the author of the 
document (from "Richard Mander"). In step 817, the user selects changes to 
the criteria and indicates to the computer that these changes are acceptable. 
This causes the system to respond In step 819 by pulling in copies or aliases of 
all documents on the system having vectors which match the new pile's script 

1 5 vector. After step 81 9, the system proceeds back to monitoring any of the 
various actions/interrupts which cause entry Into the processing shown In 
Figure 17. The use of a script has many possibilities, for example, it Is noted 
that the script could Include the use of the vector representation of the pile as 
well as other features which may be matched in a boolean "AND" fashion or 
2 0 matched in a boolean "OR" fashion. 

Figure 18a shows a method of the present Invention for creating subpiles 
from a pile or other selected set of documents (e.g. documems within a folder). 
This method would be invoked In various ways by the user or perhjaps under 
2 5 system control automatically (e.g. as a result of a search where the user 

requests the search results pile to be processed into subpiles after the search). 
For example, the user could place a pile such as pile 550 Into the visualization 
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Window 551 shown In Figure 13a and then select the command pile by content 
causing the system to respond, as shown In Figure 13b with four subpiles 
created by the system. If the sy^em determines, in step 851 . that the user wants 
to create subpiles from a pile, then pR)cesslng proceeds to step 853 in which 
5 the system determines whethertitere any documents which are left In the 
original pile. If no documents are left in the pile processing proceeds through 
node F2 to step 871 . in the beginning of a subplfing process, typically 
documents will be remaining in the pile and thus proces^ng proceeds to step 
855 in which the first document Is taken from the pile and is designated as the 
Id current document. Then processing proceeds to step 857 In which the system 
compares the similarity of the current document to each existing subpile. This 
can be done In many different ways as described above, including the 
calculaUon of the dot product between the vector of the document and each 
subplle's vector. The similarity measure, which may be the dot product 
1 5 described above. Is compared to athreshold whfch may be estabfished by the 
system or by the user. For example, the user may be presented with a graphical 
slider, the Icnob of which may be selected and moved along the slide to vary the 
threshold which wnti then vary the amount of subpiles which are created by the 
system during the process of subpifing. In the case of the first document from a 
20 pile, this test In step 859 will result automatically in the creation of a new subpile 
since there are no existing subpiles. After the first document in the pile, the test 
in step 859 willdetermine whether a new subpile is created, which occurs in 
step 861. In step 861 , the new subpile Is created with the current document as 
the seed document of the new subpile which thereby determines the Internal 
2 5 representation of the subpile. If processing proceeded through step 861 . then it 
loops back to step 853 as shown in Figure 18a. 



93/22738 



61 



PCr/liW3/02878 



If the result of the test in step 859 Is a "yes" then processing proceeds to 
step 863. in which the system sorts the matching subpiles (i-e. subpiles 
producing a similarity measure with the document which exceed the threshold) 
by similarity measurement to the cun'ent document Then in step 865, the 
system determines whether a document is allowed to be in more than one 
subpile. If not. processing proceeds to step 669 In which the current documem 
is added to best matching (on the basis of a similarity measure) subpile. Also In 
step 869. the system updates the mnning similarity score by adding the 
similarity score, which may be the dot product between the document's vector 
and the best matching subpile's vector, to the mnning total of the similarity score 
for the entire subpifing system, which is initialized at zero prior to beginning the 
process shown in Figure 18a. If a current document is allowed to be In more 
than one subpile. then processing proceeds to step 867 in which the current 
document is added to all matching subpiles having a similarity measurement 
which exceeded the threshold. As in step 869. the mnning similarity score for 
the system is updated by adding the dot products or other similarity scores (one 
for each matching subpile to which the cun-ent document was added) to the 
mnning total for the system. Following step 867 or 869, processing loops back 
to node F1 and the various steps described above. It is noted that if the 
document is to be added to more than one subpile, either a copy of the 
document or an aliases/pointer to a copy of the document may be stored in the 
subpile. In a manner which is similar to the conventional prior ait technique of 
storing a file or an aliases/pointer of a file in a subdirectory or folder. 

If at any step of the process of creating a subpile, there are no documents 
left in the original pile, then the decision required in step 653 results in the 
system proceeding to step 871 in which the system determines whether there 
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are any subpiles which contain only a Single document. If no such subplle 
exists then processing proceeds to node F3 which results in step 876 being 
performed, otherwise, processing proceeds from step 871 to step 873 in which 
a miscellaneous subpile is created. Then, in step 874. each dpcumant from a 
5 single document subpile is transferred to the miscellaneous pile "(and the 
running similarity score is updated) and the single document subpiles are 
removed from the system in step 875. Then, in step 876. the system determines 
whether any improvement to the total system similarity score has occurred since 
the last total similarity score. This system similarity score is computed as 
1 0 described above in steps 867 and 869 each time a document is added to a 
matching subpile and after all documents have been removed from the original 
pile this test in step 867 is typically performed; obviously, in the first pass 
through this step, the system will place all documents back in the original pile by 
proceeding to step 877 and then back to node F1 . repeating the process while 
5 maintaining in storage a record of the prior total similarity score. It will be 
appreciated that this total similarity score is only for documents in the original 
pile and only for similarity measurements between those documents and . 
subpiles created during the subpiling process described here. The test in step 
876may include a comparison to a threshold where the difference, which 
0 should be an improvement, between the prior total system similarity score and 
the current total system similarity score is compared to a threshold and if that 
difference does not exceed the threshold, then no effecUve Improvement has 
occurred and processing is (completed. A designer of a system using the 
present invention may decide that it is efficient and reasonably accurate to 
5 merely repeat the process of subpiling only once or some fixed number of times 
rather than attempting to access an improvement at the end of each subpiling 
pass. 
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Figure 16b shows an alternative subpiling process according to the 
present invention where the user chooses the number of subplles which are to 
be created from the original pile. This is typically done in order to avoid 
5 unnecessary clutter of subpiles. Without this feature, ft is possible that the 
computer filing system of the present invention could create tpo many subpiles 
making it more dIfficuH for the user to manage and organize the piles created in 
this manner. The process of Figure 18b beings at step 880 in which the system 
determines the number of subpiles which are allowed by the user when a 
1 0 subpiling process is invoked. Processing then proceeds to step 882 to 

determine whether the desired number of subpiles have been created so far in 
the subpiling process. If they have, processing proceeds through node J2 to 
step 891. and othenvise processing proceeds to step 884 in which the system 
computes the total similarity of each remaining document in the original pile to 
1 5 all existing subpiles. In the special case of the first document which is removed 
from the original pile, there is nothing to compute since no subplle exists. Then, 
in step 886 the remaining documents are sorted from least to most total 
similarity. Then in step 888. the document in the original pile with the least total 
similarity is removed from the original pile. In the case of the first document 
20 which is removed from the original pile, any document will do. Then, in step 
890 a new subpile Is created with the document whfeh was removed in step 
888. using that document as the seed for the similarity measurement 
comparisons (e.g. the document's vector is used for the subpile's vector). Then 
processing proceeds back to step 882 in which this process repeats through 
2 5 steps 884 through 890 unless processing proceeds through node J2 to step 
891. In the second pass through steps 884 through 890. step 884 does involve 
the computation of the total similarity of each remaining document in the original 
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pile to alf existing subpHes. This Is done in the fashion descHtwd above 
Wherein the Internal representation of each document is used with the internal 
representation of each subpile to compute a similarity measurement between 
the document and each subpile. Thetotal similarity for a document to all 
5 ««sting subplles Is a summation of each Similarity measuremem'betw^^ 
document and all exisBng subpttes. Thus, for example. If four subplles exist 
when the computation is made, four dot products may be computed as the 
similarity measurement, each dot product being between the document's vector 
and the seed vector of the four existing subplles; these four dot products are 
0 then added together to provide a total sImllaHty measurement for the document. 
Then in step 886. these total similarity measurements for each document are 
sorted. The document with the least total similarity In this sorted list is removed 
from the pile in step 888 and a new subpile is created with this document as a 
seed as shown in step 890 and the processing continues back to step 882. 
5 When the number of subplles which exist by virtue Of the subpifingpmcess 
equals the desired number selected ty the user, processing proceeds to step 
891 which determines whether there are any documents left in the original pile. 
If the answer Is no. the process is completed. However, if the answer from step 
891 is yes. processing proceeds to step 893 in which the system takes the first 
0 remaining document from the original pile and labels It the current document 
and then proceeds to step 895. In step 895. the system compares the similarity 

of the current document to each ejdsting subpile and then in step 897. the 
system sorts the matching subplles by similarity to the current document, in step 
899, the system adds the current document to the best matching subpile and 
proceeds back to step 891. The forgoing description of the processof subpiling 
from an original pile has been described with reference to a spedfic procedure: 
however, using known infomiatlon retrieval technology, other implementations 
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10 



Will be available to those in the art upon reference to this description and the 
information retrieval art. 

An alternative to the process of creating a subpile according to either of 
the methods shown in Figure 18a or 18b will be described. Prior to starting the 
subpiling process, the user may want to specify certain subpites which must be 
created: this may be done by specifying a "seed" document which is 
representative of a desired subpile or a Mrtuar seed document (specified by 
keywords which may be used to create an Imemal/content representation of the 
subpile). These desired subplles are then used by the system as subplles 
which exist Immediately upon beginning the process (e.g. entering step 853) of 
creating subplles from a pile. It should also be noted that the process of 
creating subpiles may be perfonned from several original piles merely by 
combining them Imo one original pile or by using one pile as an original pile 
1 5 and the other original piles as pre-existing subplles. 

The system and method of the present Invention also provide a 
mechanism for searching documents in the file system of the computer whether 
those documents are in piles or conventional subdirectories/folders. This 
method Is shown in Rgure 19 and begins at step 901, in which the system 
determines whether the user wants to search for documents matching a set of 
terms which are specified by the user. Typically, the user will indicate that a 
search Is desired and the system will respond wrlth a question asking the user 
whether the user wishes to define a set of terms or to specify a sample 
2 5 document. It will be appredated that, other possible means of requesting a 
search or formulating a search may be used. If the user wants to specify a set of 
terms, the system allows In step 903 the user to do so and then creates In the 



20 



wo 93/22738 



66 



PCr/US93/02878 



Step 905 a virtual document vector (or other representation of the terms) for the 
set of temis (and their user selected weights,unless by default the terms are 
equally weighted). That Is. the user specifies terms and then those temis are 
used to spedv A vector of a virtual documem which Is used later when 
5 processing. Processing from step 905 proceeds direcOy to step 91 1. If the user 
wishes to search using a sample document (ag. create a pile from a sample 
document manually by searching and obtaining a Est of the documents or 
automatically create a pile containing the search results) then processing 
proceeds from step 901 to step 907 in whichthe system requests the user to 
1 0 specity the sample document; if no sample document Is specified processing 
ioops baclcto node C waiting for an interrupt or other Instmction Indicating to 
begin the search process. After the sample document Is speofied in step 907, 
the system proceeds to step 91 1 1n which it compares each document's vector 
(or other representation of the document) In the system with the document 
1 5 vector (or other representation) of the sample document or the document vector 
(or other representation) of the virtual document created in step 905. This may 
occur by any of a number of ways of determining a similarly measure, including 
by detemiining the unit dot product of the sample document's vector against the 
vector of all documents in the system. It will be appreciated that alternative 
2 0 Similarity measures or search routines may be employed, such as measuring 
the similarity between the document and each pile or folder and then searching 
within those piles or folders having the best matches to the document It is 
noted that this comparison can eliminate documents which are not close 
enough by testing each dot product against a preselected threshold 

25 

In step 915 the system sorts the list of documents based on the 
comparison with the document vector of the sample (or virtual) document. This 
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Hst may be limited by the comparison against a preselected threshold as 
described above. Then in step 917 the system creates and displays a pile of 
the sorted documents which are closest to the sample (or virtual) document. 
Following step 917 processing proceeds back node C which waits for a 
5 command to search from the user. Alternatively, the pile may be divided Into 
subpiles according to the techniques of the Invention. The user may also, after 
the search pile is created, manipulate that pile to perform other searches such 
as a new or revised search. 

1 0 Figure 20 shows a method for using cotor to assist in organizing 

information in a computer and to assist a user in understanding the content and 
organization of piles within the following system. This method begins in step 
951 wherein the user selects a pile and then in step 953 selects a method of 
visualization such as the visualization window 551 shown in Figure 13a. This 
1 5 causes the system, in step 955. and display the visuafization window showing 
the pile within the window (or the user may have to move the pile Into the 
window). Then in step 957. the user selects the command "oider by date" and 
the system orders documents in the pile by the date of the documem. H is 
appreciated that step 957 is a two-part process even though It is shown as one. 
2 0 This may be done in any of the well known ways of sorting and listing 
documents by the dale of the document. This date may be either the date 
maintained by the filing system of the documem or may be a date line (field) of 
the document which Is contained In the contents of the document and was 
provided by the author of the document. After step 957. the user In step 959 
2 5 selects the command "color by date" and the system displays documents with 
different colors and organized according to the date. It is appreciated that step 
959 is a two-part process even though it is shown as one. That is. the color of 
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the document is correlated with the age of the document in the manner 
described above. This Is done typically by determining the range of dates for 
the entire pile by determining the oldest document and the most recent 
document (and thereby determining the range) and thereby determining the 
5 range of the variable saturation for a particular color (e.g. 256 different 
saturation values for a given luminance and hue of a color). The oldest 
document would then be assigned the roost saturated color (e.g. saturation 
level equal to 255 In an 8 bit color system) and the most recent document would 
have the least saturation (e g. saturation level equal to 2ero for the same 

1 p lurninanoe and hue of a color), A document with a date in the middle of the date 

range would have half of the saturation of the oldest document and other 
documents would be proportioned accordingly. Other well known techniques 
may be used for assigning colors on the basis of the dates of the various 
documents in the pile. The user may next select "color by content" In step 961 
15 In the manner described above in conjunction with Figure 13a. This causes the 
system in step 963 to display the documents in the pile with different saturations 
of color according to the closeness (determined by a similarity measure) of the 
documerrt tq the Internal representation of the pile. This may be done by 
comparing the document's vector to the pile's vector by the using the unit dot 

2 0 product of the two vectors in the manner described above. The computer would 

determine all.dot products for ali documents in the pile and ttien sort those dot 
products from highest to smallest The highest dot product indicates a 
document which most closely matches the pile's internal representation (e.g. 
pile's vector) and the smallest dot product would indicate a document which is 
2 5 farthest away from the pile's Internal representation. This sorted list of dot 
products corresponds to a sorted Dstof documents since each dot product is 
associated with a particular document and thus different saturations of a given 
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color at the same luminance and hue may be supplied to the different 
documents according to their dot product, in other words, the dot product for a 
particular document maps to a particular saturation of a color the same way that 
the date maps to a color as described above. The user may desire that this pile 
5 retain its colored form based on coloring by content by selecting the okay button 
571 and then by closing the visualization tool window. This will cause the new 
colored pile to appear on the display means 22 in the fifing system of the 
present invention. H is noted that the order of many of the steps shown in Figure 
20 Is not critical to the Invention and these steps may be practiced in other 
1 0 sequences which are not shown. 



In order to summarize many of the features of the present, a typical 
example will be given of how a user may interact with piles. Figure 21 
represents a flow chart showing this typical example; the order of many of these 

1 5 steps is not critical to the invention and they may be practiced In other 

sequences which are not shown. Beginning in step 1001. the user creates a 
pile by moving one document on top of another. This has been described 
above in connection with Rgure 3 and other figures. The user may also create 
a pile by selecting two different documents and selecting a command available 

20 In the computer system to aeate a pile. Next the user in step 1003 moves the 
newly created pile by positioning the cursor over the base of the pile and 
signaOng the selection of the pile and then mowng the cursor to move the pile. 
In step 1005 the user selects another pile by positioning the cursor over the 
base of the pile and signalHng a selection of that pile. In step 1007, the user 

2 5 opens the pile by any one of the mechanisms for obtaining an alternate view as 
described above. For example, by rapidly depressing and releasing (double 
clicking) the mouse button while positioning the cursor over the base of the pile. 
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The system responds m step t0p9 to the actions of the user in step 1007 by 
opening a pile window with the contents of the pile displayed in that window or 
allematively by spreading put the documents In the form shown in Hgure 8d. 
An example of a pile window containing the contents of the pHe is shown Figure 
5 8a. 



In step 1011, the us^r may close the pile window by positioning the 
cursor over the close box and signalling a selection or by using any one of the 
other known techniques for closing a window in a graphical user interface. 
1 0 Then in step 1012, the user selects a document which is not in a pile and drags 
it to the top of an existing pile to add it to the pile. This is typically done in one of 
many ways for moving a documerit in a fifing system having a graphical user 
Interface, such as positioning the cursor over the Icon of the document and 
selecting the document and keeping the document selected while the cursor is 
1 5 moved thereby moving the cursor and the document on the display screen. The 
system's response to step 1012 is step 1015 in which the system displays a 
script dialog box sin6e the targeted pile to which the document was added is a 
scripted pile and since the new document has an internal representation which 
does not match the cun^ent criteria of the pile. The user selects in step 1015 to 
2 0 modify the pile's script This takes place in step 1017 in which the system 

modifies the pile's script on the basis of the user's input For example, the user 
spedfies particular criteria to use in modifying the pile's script such as selecting 
two unique words from the added document or by using a particular label such 
as the label 614 shown in Rgure 14. 

Then in step 1 01 9, the user instructs the system to add documents to the 
pile on the basis of the pile's modified script or the system does so automatically 
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atter modifying the pile's script. Whether automatic or upon user InstrucUon. the 
system adds to the pile on the basis of the new script in step 10t9. The 
computer may display an animation of document icons moving from their old 
locations on the display screen into the pile. 

5 

In step 1021 . the user instmcts the system to create subpiles of a 
selected pile based on the contents of the documents. That is. the system is 
instnjcted to create subpiles on the basis of the contents (rather than for 
example the dates of the documents or other criteria upon which subpiling may 

1 0 be based). The system responds in step 1023 by examining the contents of 
each document in the selected pile and creating several subpiles from the 
original selected pile, each subpile containing similar content because of the 
operation of the present Invention. The system as shown in step 1023 then 
assigns a name to each subpile on the basis of the words having the strongest 

1 5 weights for each subpile. 



20 



The user may then select, in step 1025, one of the subpiles by 
positioning the cursor over the base of the new pile and signalling a selection. 
The user then instructs the system to color the pile by date by selecting the 
command "color by date." This causes the system to respond in step 1027 by 
using the date of documents in the subpile to select a saturation of a color which 
Is dependent on the date of the document. For example, the most saturated 
color represents the oldest document. The user in step 1029 then removes a 
document from this subpile by selecting the document and dragging it out of the 
2 5 pile. For example, the user may select the oldest document, based on the 

saturation color and remove it from the pile and examine the document. In step 
1031 , the user selects a document which is not in any pile and selects the 
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command "put away" which causes the system to put the document into the 
closest, in relevant, pile or piles depending upon user preference. 

Another example of a user's interaction with (riles according to the 
5 present invention vrill now be described by referring to Rgures 22a, 22b, 22c, 
22d and 22e. As shown in these figures, the method and apparatus of the 
present invention may be applied to an object oriented programming 
en>rfronment where the use of piles is mader for programming documents which 
are not the typical text/based office document, even though programming files 
1 0 contain text As shown In Rgure 22a. an object finder window 2201 Includes 

three components which are the find box 2202. the results box 22Q4 and the 
discard box 2203. In this example, a search is specified by placing a sample 
document or a pile In the find box 2202 and the system wiU find objects that are 
similar to the objects in the find box 2202 provided they are not present In the 
1 5 discard box 2203. That is. the discard box 2203 acts as a "nof boolean logic 
search parameter. The results window or box 2204 shows the results of a 
search which have been automatically placed in three subpiles according to the 
present invention where the original search results were placed In a pile which 
was then divided Into three subpiles 221 0. 2211 , and 2212. 

20 

Figure 22b shows a method and apparatus of the present invention 
where piles may be used to spedV the search query rather than words or other 
query techniques. In this case^ the find box 2202 contains the piles 2219 and 
2220 which specify the search query (e.g. by using either Internal 
2 5 representation of either pile as the search query). That Is, the internal 

representation of pile 2219 is OR'ed together with the Internal representation of 
the pile 2220 so that objects which are similar to either internal representation 
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Of either pile will show up in the results window 2204. As shown in Figure 22b. 
the discard box 2203 contains the pile 2218 which is used to discard objects 
which are found in the search which match the internal representation of the 
pile 221 8. It is important to realize that the descriptions for the search query are 
5 'fuzzy- in that they are specified by the pile's Internal representation rather than 
a specific list of key words which are connected by boolean logical operators. 
The results of the search are shown In the box 2204. 

Figure 22c shows another use of the object finder 2201 where attributes 
10 of objects 2227, 2228, and 2229 are used to search the computer's filing system 
for documents and other objects which match the search criteria or have those 
attributes. These objects may be piles or other objects which may be treated as 
a text document and from which an internal representation of the document may 
be derived. 

15 

Figures 22d and 22e show a use of the invention in connection with 
media objects which represent digitized movies. Each digitized movie ("dip") 
have all been indexed by key words when they were created or when they were 
edited. The user has placed two clips (digitized movies) Into the find box 2202 

20 in order to find similar clips on the basis of the text/keywords for each dip. The 
user instruds the computer to find such dips on the basis of either clip 2231 or 
dip 2232 within the find box 2202. The system responds displaying four piles 
2233, 2234, 2235 and 2236 which match the internal description (or exceed a 
threshold set for comparison purposes against a similarity measure). In this 

2 S case, the four piles shown in the results window 2204 of Figure 22d were 
created by subpiling the original search results pile created from the find 
operation. The user may the browse one of the piles as shown in Rgure 22e to 
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look for certain items which are desired. As shown m Figure 22e. the user has 
browsed the pile 2233 to find a partfcular digitized movie, the indicia or proxy 
2238 of which is shown in the view cone 2237 as shown in Figure 22e. it will be 
appreciated that the proxy in the case of a movie may actually be an animated 
5 dicon of the digitized movie in that various frames of the movie may be 
displayed rapidly In sequence in order to convey the Impression the movie 
normally conveys when it is played. Similar techniques may be employed for 
other multimedia objects, such as digitized sound, etc. 

10 The foregoing method and apparatus of the present Invention may be 

conveniently implemented in a computer program In a computer system that is 
based upon the flow charts described above. No particular programming 
language has been indicated for carrying out the various procedures described 
because it is considered that the operations, steps and procedures descnl)ed 

1 5 above and Illustrated In the accompanying drawings are sufficiently disclosed to 
permit one of ordinary sWI! in the art to practice the invention. iWloreover, there 
are many computers and operating systems which may be used in practicing 
the invention and therefore no detailed computer program could be provided 
which would appHcable to these many different systems. Each user of a 
2 0 particular computer will be avyare of the languages and tools which are most 
useful for that user's needs and purposes. 

While the invention has been specifically described with reference to the 
figures and with emphasis on certain computer systems. It should be 
2 5 understood that the figures are for Illustration only and should not be taken as 
limitations upon the invention. It is contemplated that many changes and 
modifications may be made by one of ordinary skill in the art to the apparatus 
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and method of the present invention without the departing from the spirit and 
scope of the invention as claimed below. 
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We Claim: 

1. A method for organizing Information In a computer fiHng system 
having a display device and a first plurality Of documents, said method 
5 comprising : 

providing a graphical representation of a first document and a 
graphical representation of a second document from said fiist plurality of 
documents; 

creating a collection of documents comprising a second plurality of 
1 0 documents having said first document and said second document; 

displaying a graphical representation of said collection of 
documents on said display de>nce; 

viewing at least one of the documents in said collection by 
displaying an Indicia of said at least one document. 



15 



20 



2. A method as In Claim 1 further comprising the step of displaying a 
base for said collection of documents and wherein said collection of documents 
is created by one of said user and said computer filing system. 

3. A method as in claim 2 further comprising a step of selecting said 
collection of documents for further action by positioning said cursor over said 
base and by Indicating to the computer system that said collection of documents 
has been selected. 



Amethodaslnclaim i further comprising the step of: 
creating a plurality of collections of documents from said collection 
of documents by comparing an Internal representation maintained by said 
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computer system for each document in said collection of documents with an 
Internal representation created by said system for each of said collecUons of 
documents. 

5 5. A method as in claim 1 wherein the step of creating said collection 

of documents comprises positioning said cursor over said graphical 
representation of said first document and selecting said first document and 
moving said first document such that said first document overlaps said second 
document and then signalling to said computer system that a collection of 
1 0 documents is to be created. 

6. A method as in claim 1 wherein the step of creating said collection 
of documents comprises selecting both said first and said second documents 
and signalling to said computer system that a collection of documents is to be 
1 5 created. 



7. A method as in claim 1 further comprising creating a 
representation of said collection of documents based on an internal 
representation of each of the documents in said collection of documents. 

8. A method as in claim 7 wherein said computer filing system 
determines said representation of said collection of documents and wherein 
said internal representation of each of the documents in said collection of 
documents comprises a representation of words within each of the documents. 

9. A method as in claim 8 wherein said internal representation of 
each of the documents comprises, for a particular one of the documents, a 
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vector containing a representation of words within said particular one of the 
documents and a representation of the uniqueness of the words In said 
particular one of the documents relative to the words said first plurality of 
documents. 

10. A method as in claim 8 wherein said representation of said 
collection of documents comprises a vector containing a representaUon of 
words within at least some of the documents In said collection of documents. , 

11. A method as In claim 1 further comprising viewing the contents of 
said collection of documents by displaying a graphical representation of each 
document In said collection within a region on said display device. 

12. A method as In daim 3 further comprising viewing the contents of 
said collection of documents by selecting said collection and signalling to the 
computer system to display a graphical representation of each document in said 
collection withm a region on said displ^ dewce. 

T3. A method as in claum 1 further comprising viewing the contents of 
said collection of documents by displaying In an overlapping manner the 
graphical representations of each document. 

14. A method as In claim 1 wherein said step of creating a collection of 
documents comprises creating a base for said collection and selecting said first 
and said second documents and signalling to said computer system that said 
first and said second documents are in said collection. 
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1 5. A method as in daim 1 further comprising adding a third document 
having a graphical representation to said collection by selecting said third 
document and moving said third document so as to position said graphical 
representation of said third document over said graphical representation of said 

5 coHecUon and signalling to said computer system to add said third document to 
said collection. 



1 6. A method as in claim 1 5 further comprising removing said first 
document from said collection by positioning said cursor over said graphical 
representation of said first document and selecting said first document and 
moving said graphical representation of said first document away from said 
graphical representation of said collection. 



17. A method as in claim 1 wherein said step of viewing comprises 
5 pointing a cursor on said display device at a graphical representation of one of 
said documents in said collecllon for a predetermined period of time to reveal 
an indicia of said document in said collection. 



18. A method as In claim 1 7 wherein said graphical representation of 
2 0 said collection is displayed on said display device while said indicia is 

displayed on said display device. 

19. A method as in claim 1 8 wherein a means for indicating the 
location of said document within the graphical representation of said collection 

* 25 is displayed when said indicia is displayed. 
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20. A method as in claim 19 vdierein said means for indicating the 
focation comprises a graphical representation having a cone shape which has 
an apex and a base, said apex being adjacent to tha location of said document. 

5 21 . A method as In claim 1 7 whermn said collection of documents 

comprises mail documents which originated from an electronic mail message 
and wherein said indicia for each of said mail documents comprises a fist of 
words in each of said mail documents! 

10 22. A method as in claim 17 wherein said indicia is a hfiiniature of said 

document. 

23. A method as in claim 17 wherein said indida is a reproduction of 
said document 

15 

24. A method as in claim 1 7 wherein said indicia has multiple pages 
for a multiple page document and wherein the user views the multiple pages of 
said indicia by signalling to the computer to move from page to page of said 
Indicia. 

20 

25. A method as in claim 21 wherein indicia for documents In said 
collection other than said mail documents IncTude miniatures of said documents 
other than said mail documents. 



25 



26. A method as in claim 21 further comprising creating a 
representation of said collection of documents based on an internal 
representation of each of the documents in said collection and wherein said list 



wo 93/22738 

PCr/US93/02878 

81 

Of words for each mail docurrtent is obtained from said internal representation of 
each mail document. 



10 



27. A method as in claim 26 wherein said internal representation of 
each of the documents In said collection comprises, for a particular one of the 
documents, a vector containing a representation of words within said particular 
one of the documents and a representation of the uniqueness of words in said 
particular one of the documents relative to the words in said first plurality of 
documents. 



28. A method as in claim 1 5 further comprising providing a first zone of 
a second zone on said graphical representation of said collection and wherein 
when said graphical representation of said third document is positioned over 
said first zone, the user of said computer system controls the orientation of the 

1 5 graphical representation of said third document relative to said collection so that 
the user controls the appearance of said graphical representation of said 
collection to the extent of the orientation of said graphical representation of said 
third document relative to said graphical representation of said collection, and 
wherein when said graphical representation of said third document is 

2 0 pos'itioned over said second zone, the computer systems controls the 

orientation of the graphical representation of said third document relative to said 
collection so that the computer system controls the appearance of said 
graphical representation of said collection. 

25 29. A method as in daim 1 wherein said graphical representation of 

said collection conveys visual information about the contents of said collection. 
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30. A method as In claim 29 wherein said graphical representation of 
said collection is dynamic such that adding or removing documents to said 
collection changes the graphical representation of said collection. 

31 . A method as In daim 1 wherein said step of creating a collection 
comprises Indicating to said computer system that a collection of documents Is 
to be created using said first document as a sample document and wherein said 
computer system searches said first plurality of documents to find said second 
document 

32. A method as in claim 31 wherein said computer filing system 
creates said collection by modifying an attribute of documents within said 
collection, wherein said attribute is used by said computer fifing ^stem for said 
first document and said second document. 

33. A method as in claim; 31 further comprising creating a 
representation of said collection of documents based on an internal 
representation of said first document. 

34. A method as in claim 8 wherein said graphteal representation is in 
multipfe colors such that said computer filing system prowdes a color for a 
particular document in said collection based on a measure of the similarity 
between the representation of said collection and the Internal representation of 
said particular document 

35. A method as In claim 34 wherein one of the hue and saturation of 
a color Is varied according to said measure of the similarity. - " 
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36. A method as In claim 7 wherein the user of said computer filing 
system provides a third document to said filing system and instructs said 
computer filing system to file said third document and wherein said computer 

5 filing system determines whether to add said third document to said collection 
based on a measure of similarity between the representation of said collection 
and an intemal representation of said third document 

37. A method for organizing information in a computer system having 
1 0 a display device, said method comprising: 

providing a representation of a first document and a 
representation of a second document; 

creating a collection of documents comprising said first and said 
second documents; 

' ^ displaying a representation of said collection of documents: 

determining a representation of said coHection when a third 
document is added to said collection based on one of: (a) an intemal 
representation of each of the documents in said collecUon. and (b) a user 
defined specification. 

20 

38. A method as in claim 37 wherein said computer system has a filing 
system having a graphical user interface and said method is perfomied In part 
by said filing system and wherein said representations of said first document, 
said second document, and said collection of documents are graphical 
25 representations. 
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39. A method as in claim 38 wherein said user defined spedfication is 
a sample document designated by said user to act as an intemal representation 
of said collection. 

^ 

5 40. A method as In daim 38 wherein said user defined specification Is 

a collection of words spedfied by said user. 

41. A method as in claim 38 wherein Intemal representations of 
documents in said collection are used to determine relevancy comparisons 

1 0 between said collection of documents and a third document added by one of 
said user and said computer system. 

42. A method asm claim 38 wherein said user defined specification 
comprises a programmable means for causing the execution of a series of 

1 5 Instmotlons and wherein said programmable means is acthrated by selecting a 
graphical representation of said user defined specification on said display 
device. 

43. A method as in claim 38 wherein said step of determining an 

2 0 Intemal representation of said collection occurs each time a document is added 
to or removed from said collection. 

44. A method as in daim 43 wherein said step of determining a 
representation of said cpHection occurs each time a modified document is 

25 stored to replace a preexisting document in said collection. 
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45. A method as In claim 38 further comprising viewing at least one of 
the documents in said collection by positioning a cursor provided by said 
computer system on said display device on a graphical representation of said at 
least one document in said collection for a predetermined period of time to 
5 reveal an indicia of said document in said collection. 



46. A method as in claim 45 wherein said graphical representation of 
said collection is displayed on said display device while said indicia is 
displayed on said display device and wherein salo Indicia is a graphical 
1 0 representation of said document. 



47. A method as in claim 46 wherein a means for indicating the 
location of said document within the graphical representation of said collection 
is displayed when said indicia is displayed. 

15 

48. A method as in claim 45 wherein said computer filing system 
provides a call to the program which created said at least one document and 
said program responds to said computer filing system by providing said indicia. 

20 49. A method as in claim 38 wherein said graphical representation of 

said collection includes a means for selecting said collection. 

50. A method as in claim 49 further comprising moving said collection 
by selecting said collection and Indicating to said computer system to move said 
25 collection. 
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51. A method as in daim 50 wherein safd means for selecting 
comprises at least one of a base and a top means and a wrapping means for 
identifying the documents within said collection as a ootlection and wherein 
said step of moving comprises pointing a cursor provided by said computer 
system on said display device at said means for selecting and selecUng said 
collection and moving said cursor while said collection Is selected. 

52. A method as in dam 45 further comprising selecting a selecb've 
viewing mode such that only a user spedfied type of document Is selected for 
viewing wherein onfy indfda for said user specified type of document is 
displayed when viewing documents in said ooliedion during said seledhre 
viewing mode. 

53. A method as In claim 52 wherein said user spedfied type of 
document is one of 0) documents coritalning pictures, Oi) electronic mall 
documents, (ill) documents containing a "To" field, and Qv) documents 
containing a chart. 

54. A method as in claim 38 further comprising sewing at least one of 
the documents in said collection by selecting said at least one document to 
reveal an indida of said document in said collection. 

55. A method as in claim 54 further comprising moving said graphical 
representation of said document to a location near said colledion. said step of 
moving being performed by said computer system after seleding said 
document. 
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56. A method as in claim 55 wherein said step of moving is an 
animation provided by said computer system and wherein said animation 
includes flipping said graphical representation of said document. 

57. A method as in claim 55 wherein each time the user selects a 
document for viewing from said collection, a graphical representation of said 
document so selected moves to said location. 

58. A method as in claim 55 wherein said indicia is a full size 
reproduction of said document, said indicia being displayed behind the 
graphical representation of said collection and the graphical representation of 
the document at said location. 

59. A method as in claim 38 wherein said representation of said 
collection is a user defined specification and said user defined specification is 
modified and wherein said computer system adds new documems to said 
collection on the basis of said modified user defined specification. 

60. A method as In daim 59 wherein said computer ^stem adds to 
said collection on the basis of a comparison between the internal 
representation of each of said new documents and said modified user defined 
specification. 

61 . A method as in claim 38 wherein said representation of ssud 
collection is said user defined specification and wherein the user indicates to 
said computer system to add a fourth item to said collection, which fourth hern 
has an internal representation which does not match said user defined 
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specification, and wherein, after the user has indicated to add said fourth item to 
said collection, said computer system prompts the user to determine whether 
the fourth item is to be added to said collection without modifying said user 
defined spedficatipn or the fourth item is to be added and said user defined 
S spedfication is to be mocfified. 

62. A method as in claim 61 wherein said computer system prompt 
the user by displaying a window means for editing the user defined 
specification and wherein said fourth item is one of a document, a pile and a 

10 folder. 

63. A method as in daim 38 further comprising creating a plurality of 
coHections of documents from said collection of documents by comparing an 
internal representation mantained by said computer system for each document 

15 in said collection with an Internal representation created by said computer 
system for each of said collections of document 

64. A method as In claim 38 further comprising displa^ng a vWndow 
means having user commands for viewing said collection. 

20 

65. A method as In daim 63 wherein said collection of documents is a 
subdirectory of documents and wherein said graphical representation of said 
colledion is one of a folder and a container representation means for Indicating 
that said container representation means contains documents. 
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66. A computer filing ^istem for organizing Information In a computer 
system having a processor, a bus, and memory for storing information including 
a plurality of documents, said computer filing system comprising: 
a display means for producing a display of graphical 
S representations, said display means coupled to said processor; 

a cursor control means coupled to said processor, said cursor 
control means for controlling the position of a cursor on said display; 

a switch means for indicating a selection of an object displayed on 
said display, sad switch means coupled to said processor and having a first 
1 0 and a second position; 

a graphical representation of a first document and a graphical 
representation of a second document, said cursor control means and said • 
switch means being used with said graphical representations of said first and 
said second documents to create a collection of documents comprising said first 
1 5 and said second documents; 

a means for creating a graphical representation of said collection 
of documents comprising said first and said second document; and 

a means for determining a representation of said collection, said 
means for determining providing a representation based on an internal 
2 0 representation of said first and said second documents. 



67. An apparatus as in daim 66 wherein said collection of documents 
has user manipulatable graphical user interface features allowing said user to 
^ operate on said collection as a group of documents. 
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68. An apparatus as In ctefm 66 forthercomprislnfl a means for 
determining a representation of said collection each time a document is added 
to said collection. 

69. An apparatus as in claim 68 wherein said means for detemtining 
Includes a table showing the number of times a preselected group of words is 
used at least once in each of said documents stored in said computer system. 

70. A method as In claim 1 wherein said graphical representaUon is in 
muftiple colors such that said computer system provides a color for a particular 
document based oh an attribute of saidpartlcular document 

71 . A method as in daim 70 wherein one of the color parameters in a 
color space is varied according to said attribute. 

72. A method as in claim 1 wherein said step of creaUng a collection of 
documents comprises creating a means for selecting a collection of documents 
and wherein said means for sefecting includes one of a representation of said 
collection and a user defined specification. 
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